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and  interocular  contrast),  but  appear  not  to  influence  the  perception  of  motion-in-depth  in 
three-dimensional  displays  during  binocular  image  misregistration. 
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1  RATIONALE 


A  major  effort  of  this  study  is  the  generation  of  a  data  base  that 
can  be  used  to  evaluate  three-dimensional  display  ays  terns •  Early  in  the 
course  of  the  study  a  literature  survey  disclosed  three  distinct  areas 
of  information  pertaining  to  three-dimensional  display  systems  that 
required  evaluation*  These  can  be  referred  to  as  the  physical  aspects 
of  three-dimensional  display  sys terns ,  the  physiological  aspects  of 
three-dimensional  (i.e.,  depth)  perception,  and  observer-display 
interactions.  Among  the  physical  display  variables,  those  that  seemed 
most  critical  in  determining  perceptual  quality  were  luminance  level, 
luminance  contrast,  image  motion,  image  bandwidth,  and  color.  Physio¬ 
logical  variables  that  affected  the  perception  of  three-dimensional 
display  systems  included  retinal  disparity,  convergence,  binocular 
rivalry,  suppression,  and  fusional  range.  Aside  from  the  more  obvious 
observer-display  interactions  such  as  visual  acuity  relative  to  the  spa¬ 
tial  frequency  of  Images  on  the  display,  astigmatism,  viewing  angle, 
viewing  distance,  and  color  perception,  there  were  two  that  revealed 
themselves  to  be  of  some  Importance  in  predicting  the  probable  accepta¬ 
bility  of  a  given  three-dimensional  display  system.  These  were  ocular 
dominance  (and  the  related  phenomenon  of  binocular  rivalry)  and 
learning— that  is,  how  familiar  an  observer  was  with  the  display  being 
viewed . 

Each  of  the  physical  attributes  of  display  systems  outlined  above 
was  evaluated  in  the  course  of  this  study.  Likewise,  an  evaluation  of 
the  physiological  variables  of  depth  perception  was  also  undertaken  in 
an  effort  to  allow  more  accurate  prediction  of  the  perceptual  effects  of 
various  three-dimensional  display  parameters.  In  each  of  the  experi¬ 
ments  conducted  in  the  course  of  this  study,  observer-display  interac¬ 
tions  were  either  controlled  or  measured  by  the  experimenter. 
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II  METHODS 


Instrumentation 

Instrumentation  for  this  project  consisted  of  several  major  pieces 
of  apparatus,  many  of  which  were  made  available  to  the  project  at  no 
cost*  These  include  a  binocular,  dual-Purkinje-image  eyetracker,  a 
mirror-image  pair  of  stimulus  deflectors,  a  display  system  consisting  of 
either  a  rear  projection  device  or  a  computer-controlled  CRT-based  sys¬ 
tem,  a  subject  response  apparatus,  and  recording  apparatus*  Each  of 
these  major  components  is  described  below* 

Eyetracker — Two  mirror-image  copies  of  the  SRI  dual-Purkinje-image 
eyetracker  were  used  to  monitor  the  position  and  movement  of  each  of  the 
observer's  eyes.  A  schematic  diagram  of  an  eyetracker  is  presented  in 
Figure  1*  The  principles  of  operation  of  the  eyetracker  are  reported  in 
Appendix  A,  and  a  synopsis  of  those  principles  is  presented  here* 

Observers  are  maintained  in  position  with  respect  to  the  eyetracker 
by  a  dental  impression  bite-bar.  An  infrared  source  is  imaged  on  the 
observer's  eye  through  the  illumination  path,  and  reflections  of  this 
source  are  captured  in  the  collection  path.  The  first  Purkinje  image 
(from  the  anterior  surface  of  the  cornea)  is  imaged  in  the  center  of  a 
quadrant  photocell  via  a  servo-controlled  movable  mirror.  Likewise,  the 
fourth  Purkinje  image  (from  the  posterior  surface  of  the  lens)  is  imaged 
in  the  center  of  another  quadrant  photocell  by  a  second  servo-controlled 
movable  mirror.  Relative  displacements  of  the  first  and  fourth  Purkinje 
images  occur  with  both  horizontal  and  vertical  eye  movements.  Analog 
signals  corresponding  to  an  observer's  horizontal  and  eye  movements  are 
generated  from  the  position  of  the  servo-controlled  mirrors  in  the  first 
and  fourth  Purkinj e-image  systems.  Accuracy  is  on  the  order  of  1  min  of 
arc  with  this  system,  and  the  field  of  view  over  which  the  observer's 
eyes  can  be  tracked  is  approximately  25°. 

Stimulus  Deflector — While  fixed  in  position  with  respect  to  the 
eyetracker,  observers  view  stimuli  through  a  pair  of  stimulus  deflec¬ 
tors.  A  stimulus  deflector  is  presented  diagrammatic ally  in  Figure  2 
and  described  in  detail  in  Appendix  B.  A  brief  description  of  the 
device  will  indicate  how  it  was  used  in  the  present  studies. 

Each  stimulus  deflector  consists  of  a  pair  of  unity-gain  relay  lens 
systems  that  reimage  the  observer's  eye  in  the  plane  of  movable  mirrors, 
one  that  rotates  the  image  horizontally  and  another  that  rotates  the 
image  vertically.  The  axis  of  rotation  of  each  mirror  is  in  a  plane 
conjugate  to  the  center  of  rotation  of  the  observer's  eye.  Therefore, 
rotation  of  the  horizontal  mirror,  for  example,  results  in  lateral 
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FIGURE  1  SCHEMATIC  OF  EYETRACKER  SYSTEM 

S,.  IRLED  source;  IR, ,  adjustable  iris  conjugate  with  eye  pupil;  M,  and  M,  0,  coupled 
front-surface  mirrors  under  control  of  motors  MH  ,  and  Mv  ,  angle  between  mirrors 
M,  and  M10;  M2,M3iM4,M6,M7,Mb,M1  j,M12,  and  M13,  front-surface  mirrors  (mirrors 
M2.M3.M4,  and  Mg,  not  shoem,  are  used  in  different  combinations  to  alter  the  angle  6 
of  the  incoming  illumination);  M14,  front-surface  mirror  driven  by  motors  Mv  4  and 
MH'4;Mg,  dichroic  mirror;  BS,.  90/10  pellicle  beam  splitter;  BS2  and  BS3,  50/50  beam 
splitters;  P1  and  P4.  quadrant  photocells;  A,  and  A4,  apertures  in  front  of  P,  and  P4> 
respectively;  PA  and  PB,  photocells  in  automatic  focus-detection  circuit;  VT,  visual  tar¬ 
get;  IA,  input  axis;  CA,  collecting  axis;  stop  ST , ,  source  of  Purkinje  image  pattern;  LFH 
and  LFV.  linear  followers. 
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FIGURE  2  SCHEMATIC  OF  STIMULUS  DEFLECTOR 

CR,  center  of  rotation  of  eye;  L1  ,L2,l-3.  and  L4,  multiple-element  camera  lenses;  LP, 
lens  pair;  AP,  artificial  pupil;  DS,  display  screen;  Mv,  mirror  that  rotates  the  visual 
field  vertically;  MH,  mirror  that  rotates  the  visual  field  horizontally;  M1 ,  fixed  mirror; 
L4.Mh,  and  mirror  M2  move  in  synchronism  to  adjust  the  optical  distance  to  the 
display  screen. 


retinal  image  motion  the  same  as  would  occur  If  the  observer  were  to 
rotate  his  eye  horizontally.  A  similar  situation  exists  for  the  verti¬ 
cal  stimulus-deflector  mirror. 

Electrical  signals  used  to  drive  the  horizontal  and  vertical 
stimulus-deflector  mirrors  may  originate  from  any  one  of  a  number  of 
sources.  In  studies  designed  to  stabilize  the  retinal  Image,  the  sig¬ 
nals  that  drive  the  horizontal  stimulus-deflection  mirror  are  derived 
from  the  horizontal  eye-movement  signal  of  the  eyetracker,  and  the  sig¬ 
nals  that  drive  the  vertical  stimulus-deflector  mirror  are  derived  from 
the  vertical  eye-movement  signal  from  the  eyetracker.  In  studies  of 
unstablllzed  Images,  function  generators  usually  provide  the  signals  for 
the  stimulus-deflection  mirrors.  Most  often,  the  signal  will  be 
sinusoidal  In  voltage. 
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Display  Systems — The  studies  described  in  this  report  utilized  two 
major  kinds  of  display  systems:  a  rear  projection  system  using  a  Kodak 
Carousel®  projector  and  a  computer-controlled,  three-dimensional  display 
system  using  two  CRTs.  The  rear  projection  system  was  used  in  two 
modes.  When  it  was  desirable  for  both  monocular  images  to  be  identical, 
the  rear  projection  screen  was  illuminated  by  a  single  beam.  (It  was 
possible  to  present  two  monocular  views  of  the  stimulus,  one  to  each  of 
the  observer's  eyes,  by  appropriately  rotating  the  horizontal  mirror  in 
each  stimulus  deflector.)  When  nonidentical  images  were  to  be  presented 
to  each  of  the  observer's  eyes,  a  rear  projection  system  similar  to  that 
shown  in  Figure  3  was  used.  A  pair  of  orthogonal  mirrors,  M}  and  Mj, 
separated  the  projection  beam  into  two  beams,  and  a  pair  of  right-angle 
prisms  redirected  the  beams  to  the  rear  projection  screen.  Thus,  there 
were  two  mirror-image  projections  of  the  same  stimulus  visible  on  the 
screen.  Each  image  could  be  changed  in  intensity  by  manipulating  the 
rotatable  plane  polarizer  or  in  position  by  manipulating  the  horizontal 
and  vertical  stimulus-deflector  mirrors  in  each  stimulus-deflector 
system.  Details  of  this  projection  system  can  be  found  in  report 
N14-0742-81C-001  entitled  "The  Effect  of  Interocular  Contrast  and  Ocular 


FIGURE  3  SCHEMATIC  OF  DISPLAY  SYSTEM 

ND,  neutral  demity  filter;  PR,  rotatable  plane  polarizer;  Pv,  vertical 
plane  polarizer;  PH,  horizontal  plane  polarizer;  M,  and  M2,  front 
surface  mirrors;  P,  and  P2,  prisms. 
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Dominance  on  the  Perception  of  Motion-in-Depth  in  3-D  Displays,"  a 
technical  report  prepared  for  the  Office  of  Naval  Research  in  August 
1981. 

The  computer-controlled,  three-dimensional  display  system  is  posi¬ 
tioned  at  right  angles  to  the  rear  projection  screen.  To  view  this 
display  system,  a  large  front-surface  mirror  is  positioned  between  the 
stimulus  deflectors  and  the  rear  projection  screen.  This  mirror  is 
positioned  close  enough  to  the  stimulus  deflectors  so  that  each  of  the 
observer's  eyes  sees  only  one  of  the  Tektronix  602  display  monitors. 

Each  monitor  presents  a  256  x  256  array  of  picture  elements  or 
"pixels."  Each  pixel  may  be  presented  at  any  one  of  256  possible  levels 
of  intensity.  The  display  beam  scans  the  256  x  256  image  frame  verti¬ 
cally  at  a  rate  of  100  frames  per  second.  Scanning  is  controlled  by  a 
PDP-11/10  computer.  This  computer  generates  pattern  parameters,  con¬ 
trols  scaling  and  rotation  of  the  array,  times  the  onset  and  offset  of 
each  display  monitor,  and  provides  data  acquisition  capabilities.  The 
computer-controlled  display  system  allows  us  to  vary  stimulus  parameters 
along  dimensions  such  as  rotation  and  size  that  would  be  very  difficult 
to  produce  with  our  rear-projection  system. 

Subject  Response  Apparatus — Because  observers  were  fixed  in  posi¬ 
tion  with  dental  Impression  bite-bars,  they  were  unable  to  communicate 
their  perceptions  verbally.  To  facilitate  communications,  and  to  allow 
temporal  comparison  among  physical  stimulus  events,  physiological  sub¬ 
ject  events,  and  perceptual  subject  events,  observers  operated  a  three- 
position  switch  to  indicate  changes  in  perceptual  state.  Where  more 
than  three  states  were  to  be  specified,  the  subject  operated  a  pair  of 
three-position  switches.  Observer  responses  were  recorded  on  a  strip 
chart.  In  computer  memory,  or  both. 

Recording  Apparatus — A  variety  of  recording  systems  was  used  during 
the  course  of  the  study.  The  most  commonly  used  was  a  four-channel 
Brush  recorder  with  two  event  markers.  This  instrument  can  record  out¬ 
put  from  the  eyetracker  as  well  as  up  to  two  channels  of  subject 
response.  Usually,  recordings  of  the  type  shown  in  Figure  A  were  made. 
These  consist  of  left  and  right  horizontal  eye-movement  signals  from  the 
eyetracker,  a  vergence  signal  produced  by  differencing  the  left  and 
right  horizontal  eye-movement  signals  and  filtering  the  high-frequency 
components,  a  trace  that  shows  the  frequency  and  amplitude  of  stimulus 
motion,  and  an  event  marker  that  indicates  whether  the  subject  is  per¬ 
ceiving  the  stimulus  object  moving  laterally,  ambiguously,  or  in  depth. 
During  the  portions  of  this  study  in  which  data  acquisition  was  via  com¬ 
puter,  subject  responses  were  displayed  off-line  from  computer  memory. 
Raw  and  analyzed  data  were  displayed  on  a  Tektronix  type  611  storage 
display  unit  and  hard  copies  were  obtainable  on  an  Epson  recorder. 


FIGURE  4  PHYSIOLOGICAL  AND  SUBJECTIVE  MEASURES  OF  OBSERVER  RESPONSES 


Subjects 


Fourteen  subjects  ranging  in  age  from  18  to  42  years  participated 
in  this  study*  However,  not  all  subjects  participated  in  each  experi¬ 
ment*  During  the  preliminary  phenomenological  Investigations  involving 
stabilized  Images,  and  in  the  subsequent  quantification  of  data  obtained 
through  the  use  of  selected  image  stabilization,  two  well-trained 
observers,  the  author  and  Dr.  Robert  W.  Hammon,  served  as  subjects* 

Not  all  subjects  were  emmetropic*  To  compensate  for  any  spherical 
refractive  errors,  the  investigator  moved  the  focusing  mechanism  of  the 
stimulus  deflector  until  the  subject  indicated  best  visual  acuity*  When 
necessary,  cylindrical  lenses  of  appropriate  power  were  positioned  in 
the  stimulus  deflector  at  a  plane  conjugate  to  the  subject's  pupil  and 
oriented  to  cancel  astigmatic  errors.  Ocular  dominance  was  tested  with 
a  pin-hole  sighting  procedure. 
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Ill  RESULTS 


Both  qualitative  and  quantitative  measures  of  perceptual  response 
were  used  in  the  course  of  the  study.  In  either  case  the  goal  of  any 
given  experiment  was  a  perceptual  change  occurring  as  a  result  of  mani¬ 
pulating  stimulus  variables.  Two  techniques  were  used  to  manipulate  the 
stimulus  variables:  a  selectively  stabilized  image  technique  and  an 
unstabilized  motion-in-depth  technique.  The  selectivity  stabilized 
image  technique  produced  our  phenomenological  observations,  while  the 
motion-in-depth  technique  produced  quantitative  data.  A  combination  of 
both  techniques  was  used  to  quantify  the  phenomenology  we  observed  early 
in  this  investigation. 


Selectively  Stabilized  Images 


The  selectively  stabilized  image  technique  uses  the  eyetracker  to 
measure  a  subject's  horizontal  and  vertical  eye  rotations.  These  sig¬ 
nals  are  fed  through  an  amplifier  to  the  horizontal  and  vertical  mirrors 
of  the  stimulus  deflector  system,  respectively.  When  the  amplifier 
gains  are  set  accurately,  the  image  motion  produced  by  the  deflection 
mirrors  exactly  cancels  the  retinal  image  motion  produced  by  the 
subject's  eye  movements.  As  a  result,  the  image  is  precisely  stabilized 
on  the  subject's  retina.  Up  to  this  point,  the  technique  is  conceptu¬ 
ally  similar  to  other  stabilized  image  techniques.  However,  a  feature 
of  the  stimulus  deflector  system  allows  unstabilized  stimuli  to  be 
presented  to  the  subject  at  the  same  time  other  stimuli  are  stabilized. 
Unatabillzed  stimuli  are  introduced  at  a  plane  conjugate  to  the  retina 
identified  as  the  unstabilized  image  plane  in  Figure  2.  Unstabilized 
stimuli  in  the  form  of  edges,  apertures,  or  fixation  points  were  used  as 
required  to  present  the  subject  with  isolated  luminance  or  chrominance 
edges  or  stationary  planes  or  points  of  reference  that  do  not  disappear 
due  to  image  stabilization. 

Our  earliest  observations  involved  the  use  of  the  selectivity  sta¬ 
bilized  technique  to  evaluate  the  effect  of  loss  of  luminance  edge 
information  or  chrominance  edge  information  upon  form  and  depth  percep¬ 
tion.  In  these  experiments,  subjects  viewed  a  field  bounded  on  either 
side  by  unstabilized  edges,  usually  black,  vertical  occluders.  Stimuli 
presented  in  the  field  seen  between  the  occluders  were  stabilized  to 
disappearance. 

This  series  of  experiments  indicated  to  us  the  profound  effect  that 
edge  information  has  on  form  perception  and  induced  us  to  explore  the 
role  of  edge  information  in  stereopsis.  To  cite  a  few  examples  of  the 
effects  of  edges  on  perception,  we  were  able  to  alter  the  perception  of 
the  same  physical  stimulus  to  that  of  either  a  uniform  green  field  or  a 


uniform  red  field  simply  by  positioning  unstablllzed  edges  differently 
in  the  field.  More  specifically,  when  we  presented  subjects  with  a  red 
disk  surrounded  by  a  contiguous  green  annulus  and  stabilized  the  image 
of  the  boundary  between  the  red  disk  and  green  annulus,  we  could  make 
the  field  appear  entirely  green  by  placing  an  unstabilized  black  sur¬ 
round  so  that  its  edge  fell  entirely  within  the  green  annulus*  We  could 
also  make  the  same  stimulus  appear  completely  red  by  placing  in  the 
center  of  the  red  disk  a  black  unstabilized  disk  whose  edges  fell 
entirely  within  the  red  area.  Both  of  these  are  examples  of  the 
filllng-ln  phenomenon  that  occurs  under  normal  viewing  conditions  when 
part  of  an  image  is  suppressed. 

As  another  example,  when  we  presented  subjects  with  a  stabilized 
image  consisting  of  two  chromatic  stripes,  a  green  stripe  on  the  left 
and  a  red  stripe  on  the  right,  whose  common  boundary  was  stabilized  and 
whose  outer  edges  were  covered  by  unstabilized  black  occluders,  the 
field  appeared  filled  with  a  color  that  has  been  thought  to  be  theoreti¬ 
cally  Impossible.  The  color  was  described  by  many  subjects  as  reddish- 
green.  Once  again,  the  percept  is  consistent  with  the  available  edge 
information  in  the  visual  stimulus.  On  the  left  side,  the  subject  sees 
a  distinct  black-green  edge  and  on  the  right  side,  a  distinct  red-black 
edge,  but  there  is  no  perceptible  boundary  between  the  red  and  the  green 
stripe.  The  chromatic  information  available  at  each  edge  is  filled  in 
across  the  field  to  the  next  perceptible  edge,  resulting  in  the  percep¬ 
tion  of  this  forbidden  color. 

The  chromatic  results  presented  above,  as  well  as  achromatic 
results  of  experiments  in  which  luminance  edges  were  stabilized  to 
disappearance,  indicated  to  us  that  edges  are  extremely  important  in 
determining  the  form  and  position  of  stimulus  objects.  Furthermore,  our 
results  indicate  that  luminance  and  chrominance  edge  information  are 
handled  somewhat  differently  by  the  visual  system-  Chromatic  edges 
without  any  luminance  component  disappear  much  more  rapidly  than  lumi¬ 
nance  edges  and  seem  to  be  incapable  of  supporting  the  perception  of 
form.  These  results  prompted  us  to  examine  the  effect  of  the  same  vari¬ 
ables  on  depth  perception.  We  questioned  whether  the  visual  system 
might  be  capable  of  using  the  edge  information  available  to  both  eyes  to 
determine  the  three-dimensional  position  of  a  stimulus  object  even  when 
form  perception  of  that  object  had  been  eliminated  in  one  eye  by  image 
stabilization. 

Preliminary  phenomenological  investigations  of  the  perception  of 
motlon-in-depth  during  the  disappearance  of  one  of  a  pair  of  binocular 
images  due  to  image  stabilization  suggested  that  form  perception  may 
cease  due  to  image  stabilization  but  depth  perception  does  not*  In  that 
series  of  experiments,  subjects  viewed  the  same  stimulus  object  through 
each  stimulus  deflector.  Each  eye  viewed,  for  example,  a  black  bar  on  a 
white  background  bordered  by  unstablllzed  black  occluders.  Before  sta¬ 
bilizing  either  image  of  the  black  bar,  when  the  image  of  the  black  bar 
was  oscillated  sinusoidally  back  and  forth  in  one  eye  (with  a  frequency 
of  approximately  0.2  Hz  and  and  amplitude  of  1°  peak-to-peak),  subjects 
reported  seeing  the  fused  image  of  a  single  black  bar  that  appeared  to 
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move  in  depth  along  a  diagonal  path*  When  the  image  of  the  black  bar 
was  stabilized  on  the  subject's  other  retina  and  its  companion  image  on 
the  first  retina  was  oscillated  back  and  forth,  as  before,  subjects 
still  reported  seeing  the  bar  moving  in  depth  along  a  diagonal  path. 

This  observation  indicates  that  the  visual  system  monitors  the  edges  of 
both  retinal  Images  even  though  the  edges  of  the  stabilized  retinal 
image  had  disappeared. 

When  we  performed  the  chromatic  analog  of  the  preceding  experiment, 
by  presenting  to  the  subject  an  isoluminant  red  bar  on  a  green  field 
instead  of  a  black  bar  on  a  white  field,  the  perception  of  motion-in¬ 
depth  under  the  unstabilized  condition  was  marginal,  and  under  the  mono- 
cularly  stabilized  condition,  completely  absent.  Thus  it  seemed  to  us 
that  chromatic  edge  information  was  not  used  by  the  visual  system  for 
generating  the  perception  of  motion-in-depth. 

We  have  subsequently  quantified  our  observation  of  the  persistence 
of  the  percept  of  motion-ln-depth  during  disappearance  of  one  of  a  pair 
of  binocular  images.  We  did  this  by  measuring  the  spatial  contrast  sen¬ 
sitivity  function  first  with  both  monocular  images  visible  and  then  with 
one  of  the  images  stabilized  to  disappearance. 

In  the  experimental  paradigm  that  we  used,  each  eye  viewed  a  verti¬ 
cal  sinewave  grating  of  the  same  spatial  frequency  filling  a  circular 
aperture  of  about  6°  angular  subtense.  One  grating  was  presented  at  a 
constant  modulation  of  25  percent,  while  the  modulation  of  the  other 
could  be  varied  by  the  experimenter*  Superimposed  on  the  image  seen  by 
each  eye  was  a  fixation  target  that  was  stationary  in  the  field  of  view. 
During  each  experimental  run,  one  of  ten  spatial  frequencies  ranging 
from  0.4  to  9.2  cycles  per  degree  was  presented.  The  image  of  the 
variable-modulation  grating  was  translated  left  and  right  with  a  tri¬ 
angular  waveform  having  a  frequency  of  1/2  Hz  and  amplitude  of  1°  peak 
to  peak. 

When  the  contrast  of  the  moving  grating  was  high  enough  to  support 
stereopsis,  the  resulting  perception  was  of  a  grating  moving  in  depth 
relative  to  the  fixation  point.  When  the  contrast  of  the  moving  grating 
was  too  low  to  support  stereopsis,  the  subject  saw  this  grating  moving 
laterally.  When  the  contrast  was  very  low,  the  subject  saw  only  the 
stationary  grating. 

Each  trial  within  a  run  was  initiated  by  presenting  the  subject 
with  a  moving  grating  at  a  particular  modulation.  The  subject's  task 
was  to  decide  which  of  the  following  categories  best  described  the 
motion  of  the  grating:  motlon-in-depth  only,  mostly  depth-motion,  ambi¬ 
guous  motion,  mostly  lateral  motion,  and  lateral  motion  only.  Each  run 
consisted  of  approximately  25  trials  at  a  given  spatial  frequency. 

The  threshold  for  the  detection  of  motlon-in-depth  was  defined  as 
the  mean  of  the  modulation  values  of  the  variable  grating  resulting  in 
the  subject's  response  of  either  motlon-in-depth  only  or  mostly  motion- 
in-depth.  Likewise,  the  threshold  for  the  perception  of  lateral  motion 
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was  defined  as  the  mean  of  the  modulation  values  of  the  variable  grating 
that  resulted  In  the  subject's  response  of  lateral  motion  only  or  mostly 
lateral  motion*  These  threshold  values  were  plotted  as  a  function  of 
spatial  frequency  to  produce  motion-ln-depth  and  lateral-motion  contrast 
sensitivity  functions.  Figure  5(a)  shows  the  threshold  for  the  percep¬ 
tion  of  motlon-ln-depth  and  for  the  perception  of  lateral  motion  under 
unstabilized  conditions  at  each  of  the  ten  spatial  frequencies. 

Thresholds  for  perceiving  mot lon-in-depth  and  lateral  motion,  with 
one  Image  stabilized,  were  obtained  by  the  same  procedure.  These  thres¬ 
holds  are  plotted  in  Figure  5(b)  as  a  function  of  the  spatial  frequency 
of  the  grating.  They  reveal  the  spatial  contrast  sensitivity  function 
of  the  mot lon-in-depth  perception  mechanism  in  the  absence  of  form  per¬ 
ception  in  one  eye.  As  one  might  expect  from  the  description  of  the 
observer's  task,  the  data  are  somewhat  noisier  than  the  unstablllzed 
data.  Nonetheless,  these  data  show  that  the  effect  we  observed  some 
time  ago,  namely  that  perception  of  motion-ln-depth  is  not  eliminated  by 
stabilized  disappearance  in  one  eye,  is  both  real  and  quantifiable.  The 
most  striking  feature  of  these  curves  is  that  the  modulation  required 
for  the  perception  of  motion-in-depth  is  lower  at  most  of  the  spatial 
frequencies  tested  when  the  grating  is  stabilized  to  disappearance  in 
one  eye,  than  when  it  is  visible  to  both  eyes.  This  Implies  that  form 
perception  may  inhibit  the  perception  of  motion-ln-depth,  at  least  in 
the  range  of  1  to  5  cycles  per  degree. 

Because  the  perception  of  motlon-ln-depth  persisted  during  stabili¬ 
zation  of  one  of  a  pair  of  binocular  images  to  disappearance,  we  ques¬ 
tioned  whether  it  might  also  be  possible  for  depth  perception  to  persist 
in  the  absence  of  form  perception  in  both  eyes.  To  answer  this  ques¬ 
tion,  we  presented  the  subject  with  a  binocular  display  each  of  whose 
images  consisted  of 

•  A  vertical  black  bar  on  a  white  background. 

•  Unstablllzed  black  occluders  forming  the  left  and  right  boun¬ 
daries  of  the  background. 

•  An  unstablllzed  fixation  point  near  the  center  of  the  field. 

(Initial  observations  with  this  paradigm  indicated  that  the  fixation 
points  were  essential  for  preventing  vergence  movements  during  stabili¬ 
zation  of  the  black-bar  stimuli.)  The  subject  positioned  the  left-  and 
right-eye  Images  of  the  occluders  and  of  the  fixation  targets  so  that 
they  appeared  fused.  Thus,  the  subject  perceived  a  single  fixation 
point  centered  within  a  single  aperture.  Within  this  aperture,  the  sub¬ 
ject  viewed  the  image  of  the  black  bar  on  the  white  background.  In  each 
eye,  the  retinal  image  of  the  black  bar  was  displaced  nasally,  resulting 
in  the  perception  of  a  fused  black  bar  that  appeared  to  lie  in  a  plane 
behind  the  fixation  point— i.e.,  at  a  greater  distance  from  the  subject 
than  the  fixation  point.  This  is  shown  in  Figure  6.  When  the  image  of 
the  black  bar  was  stabilized  to  disappearance  in  both  eyes,  the  subject 
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FIGURE  6  PERCEIVED  IMAGE  PLANES  BEFORE  DISAPPEARANCE 
OF  THE  STABILIZED  IMAGES 


The  observer  views  stereoscopic  images  of  a  black  bar  that 
appears  to  be  positioned  behind  the  fixation  point  (cross). 
Two  depth  planes  are  produced:  the  plane  of  fixation  and 
the  more  distant  plane  containing  the  black  bar. 


reported  the  perception  of  a  plane  corresponding  the  plane  that  con¬ 
tained  the  now-invisible  black  bar.  The  subject's  spatial  perception  of 
the  stimulus  array  after  disappearance  of  the  bar  is  shown  in  Figure  7. 

These  observations  suggested  to  us  that  the  human  stereo  mechanism 
might  be  capable  of  using  information  present  in  the  retinal  image  that 
does  not  reach  perceptual  awareness.  To  test  this  observation,  we  modi¬ 
fied  our  apparatus  so  that  it  included  an  unstabilized  image  of  a  verti¬ 
cal  black  bar  that  could  be  used  as  a  pointer  to  indicate  the  depth 
plane  of  other  stimuli  seen  in  the  field.  The  range  of  excursion  of  the 
pointer  encompassed  both  the  depth  plane  of  the  fixation  target  and  of 
the  black  bar. 
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FIGURE  7  PERCEIVED  IMAGE  PLANES  AFTER  DISAPPEARANCE 
OF  THE  STABILIZED  IMAGES 

The  image  of  the  black  bar  is  stabilized  on  each  retina  and 
therefore  the  black  bar  disappears.  However,  the  depth  plane  that 
that  the  bar  occupies  is  still  perceived  as  a  uniform  field  at 
some  distance  behind  the  fixation  point. 


In  unstabilized  trials,  the  experimenter  moved  the  pointer  until 
the  subject  Indicated  that  it  was  the  same  distance  from  him  as  the  fix¬ 
ation  point.  The  experimenter  then  moved  the  pointer  until  the  subject 
indicated  that  it  was  at  the  same  distance  from  him  as  the  black  bar. 

Ten  trials  of  each  type  were  conducted  and  the  mean  and  standard  devia¬ 
tion  of  the  perceived  depth  plane  of  the  fixation  target  and  the  black 
bar  were  calculated.  The  same  procedure  was  used  in  stabilized  experi¬ 
ments  during  which  the  image  of  the  black  bar  had  disappeared.  Under 
these  conditions  the  subject's  task  was  to  state  when  the  pointer  was  at 
the  same  distance  from  him  as  the  fixation  target,  and  then  to  Indicate 
when  the  pointer  was  at  the  same  distance  from  him  as  the  uniform  field 
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containing  the  Invisible  black  bar.  Ten  trials  of  each  type  were  con¬ 
ducted  and  the  means  and  standard  deviations  calculated  for  the  location 
of  the  fixation  point  and  the  uniform  field. 

The  data  shown  In  Figure  8  Indicate  that  under  unstablllzed  condi¬ 
tions,  the  black  bar  appears  to  be  approximately  20  to  25  cm  behind  the 
fixation  point.  Under  stabilized  conditions,  the  uniform  field  contain¬ 
ing  the  Invisible  black  bar  also  appears  to  be  20  to  25  cm  behind  the 
fixation  target.  These  data  support  the  assumption  that  the  stereo 
mechanism  continues  to  generate  the  perception  of  depth  when  form 
perception  has  been  eliminated  in  both  eyes  due  to  retinal  Image 
stabilization. 
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FIGURE  8  PERCEIVED  DISTANCE  TO  FIXATION  POINT  AND  PLANE  OF  STRIPE 


As  previously  alluded  Co,  the  fixation  target  was  necessary  in  the 
binocular  stabilization  studies  to  minimize  vergence  movements  during 
disappearance  of  the  binocular  stimuli*  Our  monocular  stabilization 
studies  demonstrated  that  during  periods  of  image  disappearance,  move¬ 
ments  of  the  eye  in  which  the  image  was  stabilized  showed  idiosyncratic 
drift  patterns.  In  fact,  during  monocular  stabilization,  it  was  usually 
possible  for  the  experimenter  to  tell  when  the  stabilized  image  had 
disappeared  by  characteristic  changes  in  the  subject's  eye  movements. 
However,  because  the  subject's  other  eye  continued  to  view  an  unstabil¬ 
ized  (and  therefore  visible)  image,  the  resultant  eye-movement  patterns 
appeared  normal.  Furthermore,  these  normal  eye  movements  in  the  seeing 
eye  tended  to  align  the  gaze  angle  of  the  subject's  nonseeing  eye.  When 
we  stabilized  the  Images  in  both  eyes,  the  previously  available  anchor¬ 
ing  stimulus  was  eliminated.  Under  these  conditions,  before  disappear¬ 
ance  of  the  blnocularly  stabilized  image,  subjects  reported  seeing  the 
fused  black  binocular  stimulus  moving  indepth.  In  fact,  this  perceived 
motion-in-depth  was  frequently  very  compelling  and  very  rapid.  An 
analysis  of  the  eye-movement  records  obtained  during  binocular  image 
stabilization  without  fixation  targets  showed  that  subjects  were  making 
large-amplitude  vergence  movements  during  periods  when  they  reported  the 
perception  of  motion-in-depth  of  the  stimulus  object.  Furthermore,  when 
they  reported  the  approach  of  the  stimulus  object,  their  eye-movements 
records  indicated  that  they  were  making  convergent  movements. 

With  our  image-stabilization  technique  it  was  easy  to  vary  the  sig¬ 
nal  gain  between  the  eyetracker  and  the  stimulus  deflector.  Because  the 
gain  controls  the  amplitude  of  the  retinal  image  motion  for  a  given  eye 
movement,  it  also  affects  dynamic  retinal  disparity  under  binocular 
viewing  conditions.  When  the  gain  is  zero,  retinal  image  motion  and 
disparity  changes  are  Che  same  as  during  normal  unstablllzed  vision; 
when  the  gain  is  unity,  the  image  is  stabilized,  so  no  disparity  changes 
occur  with  eye  movements.  Thus,  the  foregoing  results  indicate  that 
when  retinal  disparity  changes  are  eliminated  by  stabilization  of  both 
retinal  linages,  a  subject's  vergence  system  drives  his  stereo  mechanism, 
producing  the  perception  of  motion-in-depth.  Because  we  also  have  con¬ 
trol  over  absolute  retinal  position  of  stimuli,  it  was  possible  to  gen¬ 
erate  stimuli  of  any  static  retinal  disparity.  Furthermore,  with  sta¬ 
bilization,  that  disparity  could  not  be  changed  by  a  subject's  eye  move¬ 
ments.  By  using  this  capability  we  explored  the  Interaction  between 
static  retinal  disparity  and  vergence.  We  found  that  when  the  binocular 
s t lmul 1  were  imaged  without  static  retinal  disparity — that  is,  when  each 
fovea  was  positioned  in  the  same  location  relative  to  its  image — the 
effect  of  vergence  eye  movements  on  the  perception  of  motion-in-depth 
was  minimized.  When  static  retinal  disparity  was  increased,  either  in 
the  crossed  or  the  uncrossed  mode,  a  given  vergence  eye  movement 
resulted  in  a  much  stronger  percept  of  motion-in-depth  of  the  fused 
binocular  stimulus. 

In  a  related  experiment,  the  gain  between  the  eyetracker  and 
stimulus  deflector  was  set  above  unity*  With  gain  above  unity,  the 
change  in  disparity  produced  by  a  given  eye  movement  is  opposite  to  that 
which  occurs  with  normal  eye  movements.  Consequently,  convergent  eye 
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movements  produce  dynamic  retinal  disparities  that  are  consistent  with 
those  that  are  normally  produced  by  divergent  eye  movements*  We  found 
that  a  well-trained  subject  Is  capable  of  setting  the  gain  between  the 
eyetracker  and  stimulus  deflector  such  that  the  reverse-polarity- 
dynamlc-retlnal-dlsparlty  signals  exactly  cancel  the  vergence  inputs  to 
the  stereo  mechanism*  Under  these  conditions  the  subject  could  make 
vergence  eye  movements  without  experiencing  any  motion-in-depth.  On 
several  occasions,  when  the  subject  had  increased  the  gain  slightly 
above  the  setting  that  canceled  the  vergence  and  disparity  Inputs  to 
stereopsis,  convergence  eye  movements  resulted  in  the  perception  of  the 
fused  object  receding  rather  than  advancing.  These  experiments  seem  to 
suggest  that  retinal  disparity  and  vergence  may  be  evaluated  not  only 
individually  but  also  symbiotically. 


Motion-In-Depth 

Our  motlon-in-depth  studies  Involved  the  use  of  stereograms 
presented  either  on  the  rear  projection  screen  or  on  the  computer- 
controlled  three-dimensional  display  system.  With  both  stimulus  config¬ 
urations,  subjects  were  positioned  with  respect  to  the  eyetracker  by  a 
dental  Impression  bite-bar  and  viewed  the  stimuli  through  the  stimulus 
deflectors.  In  the  experiments  presented  here,  the  stimulus  deflectors 
were  used  to  move  the  retinal  Images,  but  not  to  stabilize  them. 

In  the  first  series  of  experiments,  we  evaluated  the  luminance 
level,  contrast  level,  and  Interocular  contrast  of  the  stereo  pairs  on 
the  rear  projection  system.  The  stereo  pairs  were  produced  by  Inserting 
a  slide  into  the  projection  system  shown  in  Figure  3.  With  either  eye, 
subjects  saw  an  image  of  the  slide  centered  in  a  10°  circular  field. 

The  pattern  seen  by  each  eye  was  a  light  square  subtending  approximately 
4°  on  a  side  viewed  against  a  dark  background.  The  contrast  between  the 
square  and  its  background  was  maintained  at  one  of  several  values:  37, 
49,  67,  83,  or  96  percent.  (These  contrast  percentages  are  reported 
nominally  as  20,  40,  60,  80,  and  100,  but  are  plotted  in  the  accompany¬ 
ing  figures  at  ordinates  consistent  with  their  actual  percent  contrast 
values.)  The  target  squares  were  presented  at  one  of  two  mean  luminance 
levels:  1.5  or  3.0  foot  lamberts  (fL).  Interocular  contrast — that  is, 
the  difference  in  luminance  between  the  two  stereo  images— was  con¬ 
trolled  by  the  variable  polarizer  shown  in  Figure  3. 

The  image  of  the  target  seen  by  either  eye  was  moved  back  and  forth 
laterally  in  the  field  of  view  by  oscillating  the  horizontal  stimulus 
deflector  mirror  with  a  frequency  of  0.2  Hz  and  a  peak-to-peak  amplitude 
of  1°.  The  left  and  right  horizontal  stimulus-deflector  mirrors  moved 
in  antiphase,  so  that  when  conditions  favored  stereopsis,  the  subject 
reported  seeing  a  single  fused  stimulus  moving  in-depth  along  the 
mid line. 

In  this  study  both  objective  and  subjective  measures  of  stereopsis 
were  obtained.  Objective  measures  consisted  of  binocular,  horizontal 
eye-movement  records  and  a  vergence  signal  synthesized  by  differencing 


them.  Subjective  measures  of  the  motion  of  the  stimulus  object  were 
obtained  by  requiring  the  subject  to  move  a  three-position  switch  to 
indicate  whether  the  stimulus  was  seen  moving  only  in-depth,  ambigu¬ 
ously,  or  only  laterally.  These  measures  were  shown  in  Figure  4  along 
with  a  trace  indicating  the  amplitude  and  frequency  of  the  horizontal 
stimulus-deflector  mirrors,  identified  as  the  stimulus  signal. 

In  each  experimental  session,  a  slide  containing  a  stimulus  at  one 
of  the  contrast  levels  was  placed  in  the  projector,  and  the  variable 
polarizer  was  set  at  a  position  consistent  with  the  type  of  trial  to  be 
conducted.  When  the  variable  polarizer  was  set  at  the  45°  position,  the 
interocular  contrast  was  near  unity  and  the  subject  saw  the  stimulus 
moving  only  lndepth.  When  the  variable  polarizer  was  set  near  0  or  90°, 

the  interocular  contrast  ratio  was  high,  resulting  in  the  subject's  per¬ 

ception  of  lateral  motion  only  of  the  stimulus.  The  end  point  of  each 
trial  occurred  when  the  subject  indicated  that  the  perceived  motion  of 
the  stimulus  had  changed  state,  either  from  lateral  only  to  depth  only 
or  vice  versa.  Within  each  type  of  trial,  two  symmetrical  series  were 
run,  one  that  increased  the  luminance  of  the  image  seen  by  the  left  eye 
and  another  that  increased  the  luminance  seen  by  the  right  eye.  Ten 

trials  were  run  in  each  of  the  symmetric  series  for  a  total  of  20  trials 

per  experimental  session. 

The  angular  position  of  the  plane  polarizer  at  which  the  subject 
saw  a  complete  change  of  state  was  converted  to  an  interocular  contrast 
ratio.  These  data  for  the  interocular  contrast  ratios  at  which  the  per¬ 
ception  changed  from  motion-ln-depth  only  to  ambiguous  to  lateral  motion 
only,  when  the  stimulus  had  a  mean  luminance  of  1.5  fL,  is  plotted  in 
Figure  9  as  a  function  of  the  slide  contrast  for  trained  observers  and 
for  naive  observers.  Notice  that  trained  observers  continue  to  see 
unambiguous  motion-in-depth  at  interocular  contrast  ratios  where  naive 
observers  see  only  ambiguous  motion. 

Similar  data  were  analyzed  for  the  effect  of  ocular  dominance. 
Figure  10  shows  an  example  of  the  difference  in  effect  depending  upon 
whether  the  luminance  was  reduced  in  a  subject's  dominant  or  nondominant 
eye.  Both  ocular  dominance  and  training  were  found  to  affect  the 
interocular  contrast  ratios  at  which  an  observer  could  maintain  the  per¬ 
ception  of  motlon-ln-depth  when  viewing  a  three-dimensional  display. 

Following  the  evaluation  of  nominal  stimulus  contrast,  stimulus 
luminance,  and  interocular  contrast,  we  evaluated  the  effect  of  vertical 
registration  of  the  two  binocular  stimuli  on  the  perception  of  motion- 
in-depth.  Each  stimulus  consisted  of  a  light  square  subtending  4°  on  a 
side  with  a  luminance  of  either  1.5  or  0.75  fL  seen  against  a  darker 
background.  The  contrast  between  the  square  and  its  background  was  nom¬ 
inally  either  20,  60,  or  100  percent.  As  in  the  previous  experiment, 
horizontal  stimulus  motion  was  produced  by  driving  the  horizontal 
stimulu8-def lection  mirrors  in  antiphase  with  a  sinusoidal  signal  of  1° 
peak-to-peak  at  a  frequency  of  0.2  Hz*  In  this  experiment,  the  vertical 
deflection  mirrors  were  used  to  vary  the  vertical  alignment  of  the  two 
stereo  Images.  As  the  two  images  were  misaligned  vertically,  the 
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FIGURE  9  TRANSITION  INTEROCULAR  CONTRAST  RATIOS  OF  TRAINED  AND  NAIVE 
OBSERVERS  FOR  THE  PERCEPTION  OF  MOTION-IN-DEPTH,  AMBIGUOUS 
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FIGURE  10  TRANSITION  INTEROCULAR  CONTRAST  RATIOS  OF  THE  DOMINANT 
AND  NONDOMINANT  EYES  OF  A  RIGHT-EYE-DOMINANT  OBSERVER 
FOR  THE  PERCEPTION  OF  MOTION-IN-DEPTH,  AMBIGUOUS  MOTION, 
AND  LATERAL  MOTION  OF  A  1.5-fL  STIMULUS 
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subject  was  to  report  the  perceived  motion  of  the  stimulus  (lateral, 
ambiguous,  or  lndepth)  as  well  as  the  state  of  fusion  of  the  two  stimuli 
(completely  fused,  partially  fused,  not  fused.)  The  experimenter 
recorded  the  amplitude  of  the  dc  signal  to  the  vertical  stimulus- 
deflector  mirror  that  resulted  in  each  of  the  response  states.  Because 
either  image  could  be  above  or  below  the  other,  data  are  plotted  as  the 
mean  of  the  absolute  value  of  the  number  of  degrees  of  misalignment 
between  the  two  stimuli  within  which  the  subject  saw  the  stimulus  moving 
in  a  particular  direction  (indepth,  ambiguously,  or  laterally). 

Figure  11  shows  data  obtained  from  one  of  our  subjects.  Averaging 
across  subjects,  we  can  generalize  that  the  images  remained  fused  and 
the  subjects  saw  motion-in-depth  exclusively  when  the  vertical  misalign¬ 
ment  of  the  two  Images  was  <  ±  1°.  When  the  vertical  misalignment 
exceeded  ±  1.5  to  2  ,  subjects  tended  to  see  the  stimulus  moving  ambigu¬ 
ously.  When  the  vertical  misalignment  was  between  2  and  4°,  subjects 
reported  diplopia  and  exclusively  lateral  motion  of  the  stimuli.  These 
observations  persisted  across  the  dimension  of  stimulus  luminance  and 
stimulus  contrast. 
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FIGURE  11  VERTICAL  MISALIGNMENT  OF  BINOCULAR  IMAGES 

RESULTING  IN  THE  PERCEPTION  OF  MOTION-IN-DEPTH, 
AMBIGUOUS  MOTION,  AND  LATERAL  MOTION 


IV  DISCUSSION 


The  results  of  this  study,  Including  those  obtained  with  the  selec¬ 
tively  stabilized  image  technique  and  the  motlon-in-depth  technique, 
provide  some  basic  understanding  of  the  effect  of  various  stimulus 
parameters  upon  the  perception  of  depth  in  three-dimensional  display 
systems.  Although  the  initial  emphasis  of  the  investigation  was  not 
specifically  to  elucidate  the  effects  of  edges  displayed  in  a  three- 
dimensional  system,  discussion  of  the  results  may  be  couched  in  that 
context.  The  discussion  will  focus  upon  the  manner  in  which  edges  and 
their  degradation  affect  the  perception  of  form,  depth,  and  motion-in- 
depth  in  three-dimensional  displays. 

The  experiments  reported  above,  which  examine  the  persistence  of 
the  perception  of  motion-in-depth  during  monocular  image  disappearance, 
suggest  that  the  human  stereopsls  mechanism  is  sensitive  to  the  edges 
present  in  retinal  images  even  if  those  edges  fail  to  reach  perceptual 
awareness.  To  generate  the  perception  of  mot  ion- in-depth  in  the  absence 
of  any  monocular  motion-in-depth  cues,  it  is  necessary  for  the  human 
stereopsls  mechanism  to  compare  the  location  and  changes  in  location  of 
corresponding  edges  in  both  retinal  images.  The  results  reported  here 
suggest  that  this  capability  is  not  dependent  upon  the  binocular  percep¬ 
tion  of  form  produced  by  these  same  edges.  Furthermore,  there  is  evi¬ 
dence  presented  in  Figure  5  that  the  monocular  perception  of  form  may 
even  inhibit  the  perception  of  motion-in-depth. 

The  foregoing  discussion  of  form  perception  and  motion-in-depth 
perception  should  be  prefaced  by  the  statement  that  the  discussion  per¬ 
tains  only  to  luminance  edges.  Our  study  of  the  effect  of  lsolumlnant 
chromatic  edges  on  the  perception  of  motion-in-depth  during  disappear¬ 
ance  of  a  stabilized  image  in  one  eye  indicates  that  the  human 
stereopsls  mechanism  is  insensitive  to  purely  chromatic  edges  in  the 
retinal  image.  That  is,  edges  that  consist  of  changes  only  in  chromati- 
clty  but  not  in  luminance  do  not  appear  to  support  stereopsls.  In  fact, 
when  images  consisting  of  an  alternating  series  of  chromatic  edges  and 
luminous  edges  are  moved  laterally  on  one  of  the  subject's  retinas,  the 
blnocularly  perceived  pattern  is  the  same  as  the  stimulus  pattern  but 
its  perceived  motion  is  ambiguous,  probably  due  to  conflicting  inputs  to 
the  stereopsls  and  form-perception  mechanisms. 

The  experiments  reported  above  that  involve  stabilization  of  both 
images  of  the  stereogram  suggest  that  the  stereopsls  mechanism  does  not 
require  form  perception  in  either  eye  to  generate  the  static  perception 
of  depth.  When  corresponding  luminance  edges  are  presented  on  both 
retinas,  the  stereopsls  mechanism  can  compared  the  location  of  these 
corresponding  edges  relative  to  other  features  in  the  retinal  Images 
irrespective  of  whether  these  corresponding  edges  are  available  to  form 
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perception.  Once  again,  the  dichotomy  of  luminance  edges  and  chromatic 
edges  is  apparent  in  static  depth  perception.  Experiments  with  iso- 
luminant  chromatic  stimuli  suggest  that  the  mechanism  responsible  for 
static  depth  perception  is  sensitive  only  to  the  luminance  edges  present 
in  the  retinal  Images. 

Experiments  in  which  all  foveal  and  parafoveal  stimuli  were  stabil¬ 
ized  to  disappearance  in  both  eyes  revealed  that  vergence  movements  per 
se  were  capable  of  producing  a  compelling  percept  of  motion-in-depth. 
Because  the  images  were  stabilized,  this  percept  occurred  in  the  com¬ 
plete  absence  of  changes  in  retinal  disparity  normally  occurring  as  a 
consequence  of  eye  movements.  It  seems,  then,  that  inputs  to  stereopsis 
from  eye  movements  are  capable  of  driving  that  mechanism  even  in  the 
absence  of  changes  in  the  relative  position  of  edges  in  both  retinal 
images.  Furthermore,  when  the  corresponding  retinal  Images  of  an  edge 
are  stabilized  with  some  static  disparity,  either  crossed  or  uncrossed, 
the  input  from  the  vergence  mechanism  to  stereopsis  is  enhanced.  This 
can  be  Interpreted  to  mean  that  the  position  of  binocularly  represented 
edges  relative  to  the  fovea  is  important  in  determining  both  the  static 
perception  of  depth  and  the  magnitude  of  the  perception  of  motion-ln- 
depth  produced  by  vergence. 

The  magnitude  of  the  effect  of  vergence  input  and  of  dynamic  reti¬ 
nal  disparity  input  to  stereopsis  can  be  measured  separately  by  render¬ 
ing  these  inputs  antagonistic.  Our  preliminary  experiments  in  this  area 
have  demonstrated  the  feasibility  of  such  a  procedure  by  showing  on  a 
phenomenological  level  that  the  magnitude  of  reversed-polarity  dynamic 
retinal  disparity  inputs  can  be  adjusted  to  exactly  cancel  Inputs  from 
vergence. 

Further  systematic  studies  of  the  effects  of  luminance  edges  on  the 
perception  of  mot  ion- in-depth  revealed  the  dependence  of  the  motion-in- 
depth  mechanism  not  only  upon  the  luminance  and  contrast  of  edges  in  the 
retinal  image,  but  also  upon  the  difference  in  luminance  and  contrast 
between  the  two  retinal  images.  This  latter  quantity  we  called  intero¬ 
cular  contrast.  The  studies  of  interocular  contrast  presented  here  sug¬ 
gest  that  the  perception  of  motion-in-depth  in  stereo  displays  is  par¬ 
tially  dependent  upon  such  subjective  factors  as  the  ocular  dominance  of 
the  observer  and  the  amount  of  experience  the  observer  has  had  with 
three-dimensional  displays. 

Our  studies  of  physical  parameters,  such  as  vertical  and  rotational 
image  misalignment,  suggest  that  the  correspondence  of  edges  in  the  two 
retinal  images  is  determined  largely  by  a  recognition  of  objects  by  the 
form-perception  mechanism.  When  the  images  of  objects  are  displaced  in 
particular  ways,  the  efficacy  of  the  edges  of  these  objects  in  producing 
the  perception  of  motion-in-depth  is  diminished.  The  vertical  image 
registration  studies  suggest  that  loss  of  the  perception  of  motlon-ln- 
depth  parallels  the  loss  of  fusion  of  the  binocular  Images  but  is  not 
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identical  to  it.  Furthermore,  fusion  may  depend  either  upon  the  abso¬ 
lute  vertical  angular  displacement  of  horizontal  edges  that  define 
objects  or  upon  the  percentage  of  the  area  of  the  object  displaced  ver¬ 
tically  on  the  two  retinas. 

In  conclusion,  the  studies  reported  here  suggest  that  edges  are 
critical  to  the  production  of  static  depth  and  motion-in-depth,  but  that 
the  description  of  a  retinal  image  edge  provided  by  the  form-perception 
mechanism  may  vary  from  that  perceived  by  the  depth-perception  mechan¬ 
ism.  When  we  understand  more  fully  what  constitutes  an  edge  for  the 
depth-perception  mechanism,  we  may  be  able  to  modify  three-dimensional 
display  systems  to  take  advantage  of  the  differences  in  the  way  the 
form-perception  and  depth-perception  mechanisms  treat  the  same  retinal 
image  information* 


V  DISSEMINATION  OF  INFORMATION 


The  principal  investigator  attended  several  conferences  where  he 
reported  the  findings  of  this  study.  In  October  1979,  he  co-authored  a 
paper  with  Dr.  Hewitt  D.  Crane  entitled  "Selectively  Stabilized  Retinal 
Images"  that  was  presented  at  the  European  Conference  on  Visual  Percep¬ 
tion  in  Noordwijkerhout ,  The  Netherlands.  This  paper  reported  the 
essence  of  the  selectively  stabilized  image  technique  and  outlined  some 
of  the  early  phenomenological  observations  made  with  it. 

In  January  1980,  the  principal  Investigator  attended  the  Oculo- 
Motor  Symposium  80  at  Cal  Tech  in  Pasadena  where  he  presented  a  paper 
entitled  "Selectivity  Stabilized  Images"  co-authored  by  Dr.  Hewitt  D. 
Crane.  This  report  described  the  selective  image  stabilization  tech¬ 
nique  and  reported  our  observations  while  using  it. 

A  report  co-authored  by  the  principal  investigator  and  Dr.  Hewitt 
D.  Crane  entitled  "Stereopsis  Without  Binocular  Perception  or  Retinal 
Disparity"  was  presented  at  the  Topical  Meeting  on  Recent  Advances  in 
Vision  sponsored  by  the  Optical  Society  of  America  in  Sarasota,  Florida 
during  April  1980.  This  report  concentrated  on  the  effects  of  image 
stabilization  on  binocular  vision  and  stereopsis. 

In  April  1981,  the  principal  investigator  in  collaboration  with  Dr. 
Hewitt  D.  Crane  presented  a  paper  entitled  "Depth  Perception  with  Selec¬ 
tively  Stabilized  Images"  at  the  Spring  Meeting  of  The  Association  for 
Research  in  Vision  and  Ophthalmology  in  Sarasota,  Florida.  This  report 
was  the  first  quantitative  description  of  the  persistence  of  perceiving 
motion-in-depth  during  stabilization  of  one  of  a  pair  of  binocular 
images. 

A  technical  report  entitled  "The  Effect  of  Interocular  Contrast  and 
Ocular  Dominance  on  the  Perception  of  Motion-in-Depth  in  3-0  Displays" 
was  written  in  1981  by  the  principal  investigator  and  Dr.  Robert  W. 
Hammon.  This  technical  report  documented  the  effects  of  changes  in  the 
mean  luminance  level  and  interocular  contrast  on  the  unambiguous  percep¬ 
tion  of  mot  ion-in-depth  in  three-dimensional  display  systems,  as  well  as 
describing  changes  in  the  perception  of  motlon-in-depth  attributable  to 
the  ocular  dominance  of  observers.  This  report  has  been  submitted  to 
the  Catalogue  of  Selected  Documents  in  Psychology. 

During  October  1981,  the  principal  investigator  attended  a  workshop 
on  modeling  control  of  eye  movements  at  Carnegle-Mellon  University. 

This  workshop  was  sponsored  by  the  U.S.  Naval  Air  Systems  Command/Naval 


29 


Training  Equipment  Center*  The  principal  Investigator  presented  a  paper 
entitled  "Stereopsls  Without  Binocular  Perception  or  Retinal  Disparity," 
which  updated  his  findings  on  the  effect  of  partial  or  complete  Image 
stabilization  on  stereopsls. 

In  January  1982,  the  author  will  present  a  paper  entitled 
"Stereopsls  Has  the  'Edge'  In  3-D  Displays"  to  be  read  at  a  meeting 
Jointly  sponsored  by  the  National  Research  Council's  Committee  on  Human 
Factors  and  the  Naval  Air  Systems  Command.  This  paper  will  summarize 
the  results  of  this  study,  and  will  integrate  Information  gained  through 
stabilized  and  unstabilized  techniques. 

A  manuscript  tentatively  entitled  "Separation  of  Form  and  Depth 
Perception  by  Retinal  Image  Stabilization"  Is  In  preparation.  When  com¬ 
pleted,  It  will  be  submitted  to  Science.  A  second  manuscript  based  upon 
the  Technical  Report  mentioned  above  is  In  preparation  for  submission  to 
Vision  Research. 
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Accurate  three-dimensional  eyetracker 


H.  D.  Crane  and  C.  M.  Steele 


A  combined  optometer  and  eyetracking  instrument  has  been  developed  to  measure  both  the  dynamic  refrac¬ 
tive  power  and  the  direction  of  gaze  of  the  same  eye.  In  effect,  this  instrument  measures,  as  a  function  of 
time,  the  point  in  .‘M)  space  on  which  the  eye  is  fixated.  Nothing  is  attached  to  the  subject  (patient),  who 
is  easily  aligned  in  the  device.  The  measuring  wavelength  is  in  the  near  ir  and  is  invisible.  The  usable  field 
of  the  instrument  is  greater  than  20°;  the  horizontal  and  vertical  directions  of  gaze  are  measured  with  a  noise 
level  and  repeatability  of  about  1  min  of  arc.  The  range  of  the  optometer  is  approximately  —4  to  +12  diop¬ 
ters;  refractive  power  is  measured  to  about  0.1  diopter.  Two  instruments  may  be  aligned  side  by  side  for 
tracking  both  eyes  simultaneously.  Three-dimensional  monocular  and  binocular  eye  movement  records  are 
shown. 


I.  Introduction 

The  instrument  described  in  this  article  evolved 
from  a  series  of  experiments  on  the  mechanisms  of  vi¬ 
sual  accommodation.  Karly  in  our  accommodation 
studies,  it  became  apparent  that  merely  measuring  the 
refractive  power  of  the  eye  was  not  sufficient.  We  were 
also  interested  in  isolating  small  retinal  areas  (to  map 
sensitivity  to  blur  over  different  regions  of  the  retina) 
and  in  measuring  the  interaction  between  eye  move¬ 
ments  and  the  accommodation  system.  For  these 
studies,  the  two  measurement  instruments  described 
in  this  paper  were  developed  to  function  simultaneously 
on  I  he  same  eye:  an  optometer1  to  measure  the  re¬ 
fractive  power  of  I  he  eye  and  a  double- Purkinje-image 
eyetracker  -  to  measure  the  direct  ion  of  the  visual  axis, 
Im >1  h  continuously  Kxpcrimental  paradigms  are  much 
more  restricted  if  accommodation  measurements  are 
limited  to  one  eye,  while  eve-movement  measurements 
are  performed  on  the  other  eye. 

'I’his  newly  developed  instrument  system  measures 
the  |Miint  in  three-dimensional  CM))  space  on  which  the 
eve  is  fixated.  The  instrument  can  thus  he  thought  of 
as  a  It-I)  eyetracker.  The  direction  of  gaze  is  measured 
with  a  noise  level  and  repeatability  of  a  Unit  I  min  of  are 
rms.  Ito tractive  power  is  measured  with  a  noise  level 
ofalsiul  0.1  diopter. 
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The  fundamental  operating  principle  of  each  in¬ 
strument  is  discussed  separately,  followed  by  a  de¬ 
scription  of  the  combined  instrument. 

II.  Purkinje  Eyetracker 

Corneal  and  limbus  eyet  rackers  can  record  very  small 
eye  movements,  hut  their  accuracy  is  poor.  This  inac¬ 
curacy  arises  from  eye  translation  movements,  which 
are  indistinguishable  from  eye  rotation  movements. 
For  example,  0.1  mm  of  eye  translation  causes  ap¬ 
proximately  a  1°  artifactual  signal  in  the  eve-rotation 
record  from  a  cornea  I -reflection  or  limbus  eyetracker. 

The  double- Purkinje  method  of  eyetracking  elimi¬ 
nates  the  translation  artifact  from  the  eye-rotation 
measurement.  It  is  based  on  the  use  of  a  pair  of  re¬ 
flections  from  optical  surfaces  of  the  eye.  These  re¬ 
flections  move  by  the  same  amount  with  eye  translation 
but  differentially  wit  h  eye  rotat  ion.  By  monitoring  the 
spatinl  separation  of  these  two  images,  eve  rotation  can 
be  measured  accurately  without  being  confused  by 
translation.  Similarly,  eve  translation  can  lie  measured 
accurately  without  being  confused  by  eye  rotation. 

A.  Purkinje  Images 

The  virtual  image  formed  by  light  reflected  from  the 
anterior  surface  of  the  cornea  is  known  as  the  first 
Purkinje  image,  or  corneal  reflex  |see  Fig.  I  (a)].  A 
second  Purkinje  image,  formed  by  the  component  of 
light  reflected  from  the  posterior  surface  of  the  cornea, 
is  almost  coincident  with  the  first  Purkinje  image.  The 
light  that  is  not  reflected  from  either  of  these  surfaces 
passes  through  the  cornea,  through  the  aqueous  humor, 
and  then  through  the  lens  of  the  eye.  The  third  Pur¬ 
kinje  image,  a  virtual  image  formed  by  the  component 
of  the  light  reflected  from  the  anterior  surface  of  the 
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Fig.  1 .  (a)  Schematic  of  the  eye:  IL ,  incoming  light;  PR,  Purkinje 

reflections;  A ,  aqueous;  C.  cornea;  .S,  sclera;  V,  vitreous;  /,  iris;  L,  lens; 
Or,  center  of  rotation;  EA,  eye  axis  (a  6  mm,  6  ^  12.5  mm,  c  ^  13.5 
mm,  d  24  mm,  r  7.8  mm).  The  transmitted  component  of  IL 
is  refracted  at  each  surface  of  the  eye,  as  is  each  reflected  component 
as  it  passes  back  through  these  surfaces.  For  simplicity,  however,  this 
refraction  is  ignored  in  the  figure,  (b)  The  first  and  fourth  Purkinje 
mirrors  essentially  form  a  clamshell  arrangement.  C i  and  C4  are  the 
centers  of  curvature  of  the  two  respective  mirrors,  (c)  Location  of 
the  first  and  fourth  Purkinje  images,  Px  and  P4,  for  collimated  input 
light  at  an  angle  or  from  the  optic  axis  of  the  eye. 


Although  the  fourth  Purkinje  image  is  almost  the 
same  size  and  is  formed  in  almost  the  same  plane  as  is 
the  first  Purkinje  image,  it  is  very  dim  because  the  dif¬ 
ference  in  the  refractive  index  between  the  lens  and  the 
vitreous  humor  is  very  small;  the  intensity  of  the  fourth 
Purkinje  image  is  less  than  %%  that  of  the  first  Purkinje 
image. 

A  more  detailed  discussion  of  Purkinje  image  for¬ 
mation  and  movement  is  given  in  Ref.  2. 

B.  First-Generation  Eyetracker 

An  early  douhle-Purkinje-image  eyetracker  system 
is  shown  in  Fig.  2.  A  light  source  S  is  imaged  by  lens  L  i 
onto  stop  S  i,  which  defines  the  effective  size  of  the  light 
source.  Stop  St  is  in  the  focal  plane  of  lens  L?. 
Therefore,  an  image  of  S]  is  formed  in  the  focal  plane 
of  lens  L3,  which  is  made  coincident  with  the  pupil  plane 
of  the  eye. 

First  and  fourth  Purkinje  images  are  formed  of  stop 
S 2,  which  is  located  in  the  focal  plane  of  lens  L3.  Stop 
S2,  therefore,  appears  to  the  eye  at  optical  infinity.  All 
the  light  emerging  from  stop  S2  passes  through  the 
image  of  S 1  formed  at  the  eye. 

First  and  fourth  Purkinje  images  of  stop  S2  are 
formed  approximately  in  the  plane  of  the  eye  pupil. 
Light  from  these  images  is,  in  turn,  reflected  by  dichroic 
mirror  DC,  reimaged  by  lens  L4,  reflected  by  mirror  M, 
and  divided  by  beam  splitter  BS,  to  form  two  pairs  of 
images.  A,  is  a  diaphragm  containing  a  small  round 
hole  positioned  to  pass  the  fourth  image  to  quadrant 
photocell  P4.  This  diaphragm,  which  is  attached  to  P4, 
blocks  the  light  from  the  first  Purkinje  image.  Beam 
splitter  BS  reflects  about  10%  of  the  incident  light 


lens,  is  much  larger  and  more  diffuse  than  the  other 
Purkinje  images  and  is  formed  in  a  plane  far  removed 
from  the  plane  of  the  other  images.  The  fourth  Pur¬ 
kinje  image  is  formed  by  light  reflected  from  the  pos¬ 
terior  surface  of  the  lens  at  its  interface  with  the  vitreous 
humor.  The  rear  surface  of  the  lens  acts  as  a  concave 
mirror,  forming  a  real  image  of  the  source. 

The  equivalent  mirror  surfaces  that  cause  the  first 
and  fourth  Purkinje  reflection  components  form  a  basic 
clamshell  arrangement.  That  is,  the  center  of  curvature 
for  the  first  Purkinje  mirror  C 1  and  the  center  of  cur¬ 
vature  for  the  equivalent  fourth  Purkinje  mirror  C4  lie 
approximately  within  the  opposite  mirror  surfaces  (Fig. 
1(b)].  Collimated  light  impinging  on  the  eye  at  an  angle 
a  forms  Purkinje  images  as  shown  in  Fig.  1(c).  The  first 
Purkinje  image,  labeled  Pi,  lies  along  the  incoming  ray 
passing  through  C 1  and  at  a  distance  equal  to  the  focal 
length  of  the  cornea  (i.e.,  one-half  of  its  radius  of  cur¬ 
vature).  The  fourth  Purkinje  image,  labeled  P4,  lies 
along  the  ray  passing  through  C4  and  at  a  distance  equal 
to  the  focal  length  of  the  equivalent  fourth  Purkinje 
mirror  (one-half  of  its  radius  of  curvature).  Because 
of  the  basic  clamshell  arrangement,  both  images  lie  al¬ 
most  exactly  in  the  same  plane,  namely  the  pupil  plane 
of  the  eye. 
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Fig.  2.  Schematic  of  the  first-generation  eyetracker  optical  system: 
E,  eye;  VT,  visual  target;  I  A,  input  axis;  CA,  collecting  axis;  CA ex¬ 
tension  of  collecting  axis;  S,  light  source;  .S’ , .  stop  imaged  at  pupil  of 
eye;  Sj,  source  of  Purkinje  pattern,  imaged  at  infinity;  DC,  dichroic 
mirror,  M,  front  surface  mirror;  Mh.i  and  Mv.i.  motors  that  drive  M 
in  horizontal  (yaw)  and  vertical  (pitch)  directions,  respectively;  Mm, 
and  Mv.i,  motors  that  drive  P,  in  horizontal  and  vertical  directions, 
respectively;  BS,  beam  splitter;  P\  and  P,.  quadrant  photocells;  A , 
and  A,,  apertures  in  front  of  P,  and  P,,  respectively. 
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Fig.  3.  Upper:  horizontal  eye  movements  recorded  from  first 
Purkinje  image  tracker  while  the  subject  fixates  a  target  at  infinity. 
Ix>wer:  simultaneous  record  from  the  fourth  Purkinje  image  output. 
The  upper  track  shows  the  wandering  baseline,  typical  of  corneal 
image  trackers  During  periods  A  and  H,  the  subject  leaned  first  one 
way  and  then  the  other  way  in  the  hiteboard.  During  period  I),  the 
biteb<»ard  was  translated  laterally  by  ^0.3  mm  and  then  returned  to 
its  original  position  Note  the  stability  of  the  lower  record  during  each 
of  these  intervals.  During  intervals  C  and  K.  the  subject  made  vol¬ 
untary  eye  movements  of  5°. 

toward  another  quadrant  photocell  P j,  which  detects 
the  first  Purkinje  image.  Diaphragm  A  i  is  positioned 
to  block  all  light  except  that  from  the  first  Purkinje 
image. 

Mirror  M  is  pivoted  at  its  center  and  is  driven  in  yaw 
(around  axis  bb;  see  inset)  and  pitch  (around  axis  aa) 
by  motors  M/i.i  and  M y.i,  respectively,  which  move  to 
maintain  the  first  Purkinje  image  centered  on  photocell 
Pi.  Control  signals  that  drive  these  two  motors  are 
derived  from  signals  from  the  four  sectors  of  P i,  which 
are  arranged  so  that  Pi  functions  simultaneously  as  a 
horizontally  oriented  split-field  cell  and  as  a  vertically 
oriented  split-field  cell. 

Photocell  P4  is  translated  horizontally  and  vertically 
by  motors  Mh, 4  and  My. 4,  which  move  to  keep  the 
fourth  Purkinje  image  centered  on  P4  (see  inset). 
Control  signals  that  drive  Mh. 4  and  Mv. 4  are  derived 
from  the  four  quadrants  of  P,,  which  also  operates  si¬ 
multaneously  as  a  horizontally  and  vertically  oriented 
split-field  cell. 

Mirror  M  thus  maintains  the  first  Purkinje  image 
stationary  on  photocell  Pi,  which  is  spatially  fixed,  while 
photocell  P4  is  servocontrolled  to  track  movement  of  the 
fourth  Purkinje  image  relative  to  the  first  Purkinje 
image.3 

If  the  eye  translates,  mirror  M  is  automatically  re¬ 
positioned  to  maintain  the  first  Purkinje  image  centered 
on  Pi;  the  same  movement  properly  repositions  the 


fourth  Purkinje  image  as  well,  and  no  movement  of  P4 
results.  If  the  eye  rotates,  however,  the  images  move 
differentially,  and  the  position  of  P4  changes  accord¬ 
ingly.  The  position  of  P4  thus  indicates  the  separation 
between  the  first  and  fourth  Purkinje  images  and  is  a 
measure  of  the  two-dimensional  (2-D)  angular  position 
of  the  eye. 

The  signals  that  drive  the  servos  are  generally  re¬ 
ferred  to  as  error  signals;  the  servos  move  until  the  error 
signals  become  zero.  The  error  signals  could  themselves 
provide  a  direct  measure  of  image  movement  without 
the  servos,  but  in  that  form  of  system  (generally  referred 
to  as  open  loop)  the  magnitudes  and  the  linearity  of  the 
output  signals  are  very  sensitive  to  factors  such  as 
component  drift  and  change  in  gain  in  both  the  photo¬ 
detectors  and  amplifiers,  variation  in  light  sensitivity 
across  the  face  of  the  photodetectors,  and  the  unifor¬ 
mity,  shape,  and  brightness  of  the  light  pattern.  The 
servos,  by  maintaining  each  image  fixed  at  an  electrical 
null  position  on  its  respective  photocell,  eliminate  the 
sensitivity  to  these  parameters  and  result  in  a  much 
more  stable  system. 

Figure  2  is  actually  a  schematic  of  the  first-generation 
eyetracker  described  in  Ref.  2. 

C.  Demonstration  of  Translation  Insensitivity 

Figure  3  shows  the  horizontal  motion  of  the  eye  while 
fixating  a  target.  The  top  record  is  the  horizontal  mo¬ 
tion  of  the  2-D  mirror  driven  from  the  first-Purkinje- 
image  cell.  The  bottom  record  is  the  horizontal 
movement  of  the  fourth-Purkinje-image  photocell  [or 
the  movement  of  the  mirror  driven  by  the  stationary 
fourth  Purkinje  photocell  in  the  new  system  (see  Fig. 
4)].  The  first  Purkinje  record  has  a  wandering  baseline, 
typical  of  corneal  (or  limbus)  eyetrackers,  that  results 
from  translation-induced  errors,  whereas  the  signal 
from  the  fourth  cell  is  independent  of  translation  ef¬ 
fects. 

For  the  record  of  Fig.  3,  a  tight  fitting  dental  plate 
(biteboard)  was  used.  During  period  A,  the  subject  was 
asked  to  lean  to  the  left  in  the  biteboard,  and  during 
period  B  to  lean  to  the  right.  Note  that  whereas  the 
lower  record  is  immune  to  such  movement,  the  upper 
record  shows  an  output  variation  of  almost  ±2°,  indi¬ 
cating  a  movement  of  the  head  with  respect  to  the 
biteboard  of  approximately  ±0.2  mm.  During  period 

D,  the  subject’s  head  was  translated  approximately  0.3 
mm  to  the  left  (with  respect  to  the  instrument)  and  then 
returned  to  its  original  position.  Note  the  3°  output 
variation  in  the  upper  record  and  again  the  stability  of 
the  lower  record  (taken  from  the  fourth  Purkinje  image 
output).  During  periods  C  and  E,  the  subject  made 
voluntary  eye  movements  of  5°  amplitude  indicating  the 
ability  of  both  systems  to  record  actual  rotation  move¬ 
ments  of  the  eye. 

Figure  3  indicates  the  difference  between  sensitivity 
and  accuracy.  A  corneal,  or  limbus,  tracker  can  detect 
very  small  eye  movements,  but  its  accuracy,  or  repeat¬ 
ability,  is  limited  by  the  artifactual  effects  produced  by 
translation  movements  of  the  eye.  We  have  recorded 
drifts  of  1-2°  that  are  indistinguishable  from  rotation 
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Fig.  4.  Schematic  of  new  eyetracker  system:  S  j ,  IRLED  source;  1R  i , 
adjustable  iris  conjugate  with  eye  pupil;  M\  and  M 10,  coupled  front 
surface  mirrors  under  control  of  motors  M«.i  and  My.r,  7,  angle  be¬ 
tween  mirrors  M\  and  A#  10;  M2,  M i,  M4,  Mfi.  A/?.  Mg,  Mu,  MI2,  and 
M i3#  front  surface  mirrors  (mirrors  M2,  M 3,  M4,  and  M&,  not  shown, 
are  used  in  different  combinations  to  alter  the  angle  0  of  the  incoming 
illumination);  Mi4,  front-surface  mirror  driven  by  motors  My.  4  and 
Mh.a,  M%  dichroic  mirror;  RS\,  90/10  pellicle  beam  splitter;  RS2  and 
RSa,  50/50  beam  splitters;  P\  and  P4,  quadrant  photocells;  A  1  and  A 4, 
apertures  in  front  of  Pi  and  P4,  respectively;  Pa  and  Pr.  photocells 
in  automatic  focus-detection  circuit;  VT,  visual  target;  I  A.  input  axis; 
(  A,  adjecting  axis;  stop  STi,  source  of  Purkinje  image  pattern;  LFr 
and  LFv,  linear  followers. 


of  1  -2°  during  a  recording  span  of  less  than  1  min  even 
with  the  head  held  rigidly  by  a  tight-fitting  dental- 
impression  plate  with  the  extra  support  of  a  forehead 
rest.  In  this  case,  translation-induced  effects  must  be 
attributable  in  large  part  to  movements  of  the  eye 
within  its  socket. 

IN.  Sacond-Gwiwation  Eyetracker 

The  new  double-Purkinje-image  eyetracking  system 
is  shown  in  Fig.  4.  This  version,  which  combines  many 
substantial  improvements  over  the  first-generation 
instrument,  greatly  extends  its  performance  and  is 
easier  to  use. 

A.  Input  Optics 

Si  is  a  solid-state  light  source  with  a  narrow  spectral 
band  centered  at  0.93->im  wavelength.  Light  from  S| 
is  electronically  chopped  at  high  frequency  (4  kHz)  to 
avoid  the  effects  of  room  light  and  to  use  ac-coupled 
amplifiers  in  the  Purkinje  image  servoeystems  thereby 
improving  stability  and  decreasing  noise. 

Lenses  L  t  and  L g  image  S 1  into  the  plane  of  an  iris 
diaphragm  IR\,  which  is  conjugate  with  the  pupil  of  the 
subject’s  eye.  Lens  L 3  is  positioned  one  focal  length 
from  the  iris  so  the  light  emerging  from  L*  is  collimated. 
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This  light  is  reflected  from  servoed  mirror  Mi  and  im¬ 
aged  by  lens  L,.  Assume  for  the  moment,  however,  that 
mirror  M\  is  fixed. 

Lens  La  is  positioned  one  focal  length  from  the  image 
of  the  light  source  formed  by  lens  L,.  The  required 
pathlength  (/,  +  fa)  between  lenses  L,  and  La  is  ob¬ 
tained  by  the  multiple  reflections  provided  by  mirrors 
M2,  M.t,  and  Af,.  An  odd  number  of  reflections  from 
these  mirrors  provides  an  inversion  of  the  horizontal 
component  of  the  input  light  path.  This  inversion  is 
necessary  for  the  proper  functioning  of  mirror  Af  1,  by 
means  of  which,  as  described  later,  the  input  light  is 
made  to  track  automatically  any  change  in  eye  posi¬ 
tion. 

Mirrors  A#fi,  Af  7,  and  Mg  form  a  Dove  mirror  system 
to  provide  an  inversion  of  the  vertical  component  of  the 
illumination  system,  which  is  also  necessary  for  proper 
input-light  tracking.  Within  the  Dove  mirror  system 
is  a  stop  ST  1,  a  circular  aperture  approximately  2.54  cm 
(1  in.)  in  diameter.  This  aperture  determines  the  size 
and  shape  of  the  Purkinje  images  formed  at  the  eye  and 
is  in  the  focal  plane  of  lens  Lg.  Thus,  light  emerging 
from  lens  Lg  is  collimated  with  respect  to  the  image  of 
the  aperture.  The  eye  is  in  the  focal  plane  of  lens  Lg 
and  is  illuminated  by  the  light  coming  from  the  light 
emitting  diode.  Dichroic  mirror  Mg  reflects  both  the 
illumination  light  and  the  light  reflected  from  the  first 
and  fourth  Purkinje  images  that  form  in  the  subject’s 
eye. 

B.  Output  Optics 

The  Purkinje  images  are  formed  in  the  pupil  plane 
of  the  eye,  which  is  in  the  focal  plane  of  output  lens  Lt. 
Thus,  light  from  the  Purkinje  images  is  collimated  be¬ 
tween  lenses  Lt  and  Lg.  The  light  that  passes  through 
lens  Lg  is  reflected  from  mirror  Afi0  onto  mirror  Mu, 
which  is  in  the  focal  plane  of  lens  Lg.4  Because  lenses 
Lt  and  Lg  have  the  same  focal  length,  a  unity  magnifi¬ 
cation  image  of  the  pupil  plane  of  the  eye  is  formed  at 
mirror  Mu- 

Minor  Mu  is  in  the  focal  plane  of  lens  Lg.  Therefore, 
the  light  emerging  from  lens  Lg  is  collimated.  Beam 
splitter  BSi  reflects  approximately  10%  of  the  incident 
light  toward  beam  splitter  BSi-  The  remaining  light 
passes  through  BS\  to  front-surface  mirror  A/13.  Beam 
splitter  BS2  reflects  and  transmits  approximately  equal 
amounts  of  light.  The  transmitted  light  is  imaged  by 
lens  Ljo  onto  the  four-quadrant  detector  Pi,  which  is 
in  the  focal  plane  of  L\0.  Pi  is  therefore  in  a  plane 
conjugate  to  mirror  Af  u  and  the  pupil  plane  of  the  eye, 
aperture  A 1  defines  the  size  of  field  seen  by  P\.  Thus, 
when  the  first  Purkinje  image  is  at  one  particular  point 
on  mirror  Mu  (or  in  the  pupil  plane  of  the  eye),  it  will 
fall  on  the  center  of  the  four-quadrant  photodetector. 
If  the  image  tends  to  move  away  from  this  point,  the 
image  at  the  detector  will  move,  and  the  resulting  error 
signals  will  drive  servomotors  Mh.i  and  Mv,\  to  repo¬ 
sition  mirror  A/10  (and  mirror  Mi).  The  mirror  is  re¬ 
positioned  in  yaw  and  pitch  to  bring  the  first  Purkinje 
image  to  its  initial  point  on  mirror  Mu  and  thus  on  the 
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photodetector.  In  this  way,  the  image  of  the  eye  formed 
at  mirror  Mu  always  has  its  corneal  reflection  in  the 
same  location. 

The  light  reflected  from  beam  splitter  BS2  reflects 
from  front-surface  mirror  Mu  and  is  imaged  by  lens  Lu 
(and  split  by  a  50/50  beam  splitter  ftS;))  onto  two 
focus-detecting  photodiodes  Pa  and  Pfl.  These  pho¬ 
todiodes  are  displaced  axially  approximately  0.5  cm  on 
either  side  of  the  plane  of  focus  of  the  first  Purkinje 
image  and,  being  small  in  size,  measure  light-flux  den¬ 
sity  along  the  axis  of  the  imaging  system.  When  the  eye 
is  in  the  correct  position  axially,  each  of  these  photo¬ 
diodes  receives  the  same  amount  of  light.  If  the  eye 
moves  axially,  one  or  the  other  of  these  photodiodes 
receives  more  light,  and  the  difference  in  light  level 
generates  an  error  signal  for  a  servomoter  that  drives  the 
carriage  containing  lens  /.7,  As  described  later,  lens  L-, 
is  repositioned  so  the  two  photodetectors  continually 
receive  equal  amounts  of  light.  This  ensures  that  the 
first  Purkinje  image  is  always  in  focus  on  P\  in  spite  of 
axial  eye  movement. 

The  light  transmitted  by  beam  splitter  BS i  reflects 
from  mirror  M )a  onto  the  servoed  mirror  M  u  and  is 
collected  by  lens  L X2.  At  the  focal  plane  of  lens  L  u  is 
a  second  four-quadrant  photodetector  /'4,  which  re¬ 
ceives  the  fourth  Purkinje  image;  aperture  A  4  defines 
the  size  of  field  seen  by  P4.  Signals  derived  from 
quadrant  cell  P4  control  motors  Mu  4  and  My, 4  These 
motors  move  mirror  Mti  in  yaw  and  pitch  to  keep  the 
fourth  Purkinje  image  centered  on  P4J' 

Opposite  each  mirror  motor  is  mounted  a  linear  mo¬ 
tion  follower  l.F  with  a  sensitivity  better  than  1  (see 
inset  of  Fig.  4).  These  motion  sensors  are  used  in  a  local 
internal  servo  feedback  loop  in  each  driver  circuit  to 
achieve  high  frequency  response  and  to  minimize  hys¬ 
teresis  and  dead  zone.  Signals  from  LFh,  1  are  used  in 
the  servo  loop  that  drives  motor  MH  and  signals  from 
LFy .1  are  used  in  the  servo  loop  that  drives  motor  My, i- 
Similar  motion  sensors  are  used  in  conjunction  with 
drive  motors  Mu  4  and  My  4. 

The  direction  of  the  eye  axis,  i.e.,  the  angle  of  gaze,  is 
derived  directly  from  LFh, 4  and  LFy  4  signals,  as  de¬ 
scribed  earlier.  Signals  from  LFh,  1  and  LFy,  1  represent 
the  horizontal  and  vertical  positions  of  the  first  Purkinje 
image,  which  moves  in  response  both  to  eye  translation 
and  eye  rotation.  By  properly  combining  the  signals 
from  LFh, 4  and  LFy, 4  with  those  from  LFh,  1  and  LF v.i, 
one  can  also  accurately  track  the  translational  position 
of  the  eye. 

C.  Automatic  Input-Path  Tracking 

The  new  instrument  is  designed  to  permit  up  to  a 
centimeter  of  eye  position  variation  in  all  dimensions: 
horizontal;  vertical;  and  axial.  For  a  large  axial  varia¬ 
tion  to  be  tolerated,  it  is  necessary  to  incorporate  au¬ 
tomatic  focus  into  the  eyetracker  (see  the  next  section 
on  automatic  focus).  For  large  lateral  variations  to  be 
tolerated,  either  a  large  input  beam  must  be  used,  so  the 
eye  never  moves  out  of  the  beam,  or  the  input  light  path 
must  track  eye  position  automatically,  in  which  case  a 


Fig.  5.  Translation  of  the  source  .S'  |.  or  source  image  S  t moves  the 
image  at  the  eye  hut  does  not  change  the  angular  separation  0  between 
the  input  axis  l  A  and  collecting  axis  (’A  A  cone  of  size  a  will  emerge 
from  each  point  of  the  pattern  in  stop  ST t,  where  a  is  the  angular  size 
of  the  source  image  .SY  as  seen  from  lens  /,«>. 


small  light  source  can  be  used.  The  latter  option  was 
chosen  because  it  offers  many  advantages;  less  total 
light  energy  directed  toward  the  eye;  a  crisper  fourth 
Purkinje  image  because  of  less  stray  light;  and  improved 
automatic  capture  because  the  first  Purkinje  tracker  can 
sometimes  lock  onto  the  iris  if  it  is  illuminated. 

For  automatic  input-path  tracking,  mirror  M\  (in  the 
input  path  of  Fig.  4),  which  was  assumed  fixed  in  the 
earlier  discussion,  is  used  to  keep  the  illumination  beam 
centered  on  the  pupil.  For  this  purpose,  mirror  M\  is 
rigidly  connected  to,  and  therefore  moves  in  synchro¬ 
nism  with,  mirror  Af10. 

To  understand  how  the  input  light  is  made  to  track 
eye  position,  note  that,  if  the  eye  moves  upward,  the 
corneal  reflection  tends  to  move  upward  on  detector  P\. 
Error  signals  generated  by  this  photodetector  reposition 
mirror  M 10  to  maintain  the  corneal  image  centered  on 
Mu.  Motion  imparted  to  Mt0,  however,  also  reposi¬ 
tions  mirror  Mi;  this  automatically  deflects  the  illu¬ 
mination  beam  upward  to  track  the  corneal  reflection. 
However,  the  illumination  tracking  cannot  be  perfect 
with  respect  to  the  pupil  of  the  eye  because  Pt  tracks  the 
corneal  reflection,  which  moves  with  respect  to  the  eye 
pupil  when  the  eye  makes  rotational  movements. 
Nevertheless,  the  design  is  such  that  the  tracking  error 
is  less  than  1  mm  with  eye  translation  of  ±0.5  cm  in  any 
direction  and  with  eye  rotations  of  15°  in  all  directions 
(30°  diam  field),  that  is,  the  input  illumination  beam 
tracks  the  center  of  the  pupil  to  within  1  mm  over  this 
range. 

A  critical  requirement  of  the  input-light  tracking 
system  is  that  a  shift  in  the  input  light  path  must  not 
cause  any  change  in  the  angle  of  the  input  axis  I A  with 
respect  to  the  eye  axis.  Any  such  change  would  alter 
the  separation  of  the  Purkinje  images  and  therefore  be 
interpreted  as  an  eye  rotation.  This  situation  is  avoided 
as  follows. 

Figure  5  shows  the  light  entering  the  eye  directly  at 
an  angle  0  to  the  collecting  axis.  (For  simplicity,  the 
dichroic  mirror  is  not  shown.)  The  input  system  con¬ 
sists  essentially  of  lens  La  located  at  its  focal  length  from 
the  eye  and  stop  ST  i  located  one  focal  length  away  from 
La.  Stop  STi  therefore  appears  to  the  eye  to  be  at  in¬ 
finity.  Stop  ST i  is  illuminated  by  Sf,  which  is  an 
image  of  iris  IR  i  and  is  in  the  focal  plane  of  lens  L*,,  The 
light  cones  emerging  from  each  point  of  ST {  are  colli¬ 
mated  by  lens  La,  and  their  intersection  at  the  eye  is  an 
image  of  Sf  and  therefore  of  iris  IR\. 
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Fig.  6.  Focus  adjustment  by  translating  lens  Ln  along  a  path  parallel 
to  the  input  axis  I A  This  method  of  focus  adjustment  maintains 
constant  optical  magnification  over  the  focus  range  and  maintains 
a  constant  final  image  position  when  the  eye  translates  along  the  input 
axis.  CA,  collecting  axis;  6,  angle  between  ('A  and  l A 

If  iris  IR  i  were  translated  in  its  own  plane,  its  image 
.S’,',  and  hence  the  image  of  S,'  at  the  eye,  would  simi¬ 
larly  translate,  but  the  collimated  ray  bundles  from  each 
point  of  ST i  would  not  change  their  angular  orientation, 
as  desired.  It  is  therefore  possible  to  achieve  the  desired 
input  tracking  simply  by  translating  the  iris.  However, 
that  would  require  yet  another  2-D  servosystem.  In¬ 
stead,  the  same  effect  is  achieved  by  placing  mirror  M\ 
in  the  collimated  light  path  between  lenses  L-\  and  L4 
(in  Fig.  4)  and  attaching  it  ligidly  to  mirror  M\0,  as  de¬ 
scribed  above.  The  required  movement  sensitivity  in 
the  input  light  path  is  obtained  by  the  proper  choice  of 
angle  y  (see  Fig.  4)  between  mirrors  M\  and  M, o- 

D.  Automatic  Focus 

To  obtain  the  desired  1  cm  of  allowed  axial  variation 
in  eye  position,  an  automatic  focus  system  tracks  the 
axial  position  of  the  eye.  Without  automatic  focus, 
intolerable  blurring  of  the  Purkinje  images  would  occur 
at  the  quadrant  photocells. 

The  automatic  focus  system  must  meet  two  stringent 
requirements:  First,  any  change  in  focus  must  not 
cause  any  change  in  optical  magnification.  A  change 
in  magnification  would  result  in  a  change  in  separation 
of  the  two  Purkinje  images  and,  therefore,  be  inter¬ 
preted  as  an  eye  rotation.  Figure  6  shows  the  eye  and 
the  two  output  lenses  Li  and  Ln\  again,  for  simplicity, 
the  dichroic  mirror  is  not  shown.  The  Purkinje  images 
are  in  the  focal  plane  of  lens  L-t.  Because  the  light  be¬ 
tween  lenses  L1  and  /,«  is  collimated,  the  eye  and  lens 
L-  can  both  move  along  axis  C A  without  any  change  in 
magnification  in  the  final  image,  as  long  as  the  distance 
between  the  eye  and  lens  L7  remains  constant.  The 
first  step  in  automatic  focus,  therefore,  is  to  have  the 
axial  position  of  lens  Li  track  the  axial  position  of  the 
eye. 

The  second  requirement  is  i  the  input  light  not 
shift  if  the  eye  translates  along  the  .nput-light  axis  I A 
In  that  case,  the  input  light  is  already  aimed  directly  at 
the  eye,  and  any  shift  would  move  the  light  away  from 
the  eye.  In  other  words,  the  automatic  focus  system 
must  be  designed  so  eye  translation  along  the  input  axis 
does  not  cause  any  shift  in  mirror  M jo,  which  in  turn 
requires  that  there  be  no  change  in  the  position  of  the 
first  Purkinje  image.  This  is  achieved  by  shifting  lens 
Li  not  along  axis  CA,  but  along  the  path  parallel  to  the 
input-light  path  l A,  as  shown  by  the  dashed  line  of  Fig. 

6.  Again,  because  the  light  between  lenses  Li  and  L* 
is  collimated,  an  equal  lateral  component  of  shift  of  the 
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eye  and  lens  Li  will  not  change  the  position  of  the  final 
image  formed  by  lens  />«.  A  shift  in  eye  position  along 
any  other  axis  will,  however,  shift  the  input-light  path 
appropriately  as  well  as  activate  the  automatic  focus 
system. 

In  Fig.  4  we  noted  that  the  signal  that  drives  the  focus 
servosystem  derives  from  the  difference  in  signals  from 
photocells  Pa  and  Pr.  This  signal  is  zero  when  the  first 
Purkinje  image  is  in  focus  on  quadrant  photocell  P\. 

Output  from  the  servosystem  that  drives  Li  provides 
a  direct  measure  of  the  axial  position  of  the  eye. 
Combined  with  the  horizontal  and  vertical  eye  position 
signals  described  earlier,  the  3-D  position  of  the  globe 
can  thus  also  be  accurately  tracked  separately  from  the 
angular  orientation  of  the  globe. 

E.  Automatic  Search 

An  automatic  search  of  the  field  is  made  whenever  the 
first  Purkinje  system  becomes  unlocked,  as  indicated 
by  an  improper  light  level  falling  on  photocell  P,.  In 
this  case,  the  first  Purkinje  mirror  is  made  to  sweep  in 
an  increasing  spiral  from  the  central  position,  and  the 
focus  servosystem  returns  to  its  central  position.  On 
the  average,  recapture  occurs  about  V2  sec  after  the 
initiation  of  a  search  action.  When  successful  capture 
has  been  achieved  by  the  first  Purkinje  system,  the  focus 
servosystem  is  reactivated,  and  a  small-field  spiral 
search  is  initiated  by  the  fourth  Purkinje  system.  (With 
the  first  Purkinje  system  locked,  the  fourth  Purkinje 
image  falls  within  a  small,  well-defined  area.)  Again, 
the  average  capture  occurs  about  V2  sec  after  initiation 
of  a  search  action,  for  a  total  average  search-and -capture 
of  about  1  sec.  Separate  light-level  detectors  in  the 
fourth  Purkinje  system  indicate  when  the  fourth  system 
is  operating  normally.  A  search  for  the  fourth  image 
is  automatically  initiated  whenever  the  fourth  light  level 
is  out  of  range. 

A  separate  output  signal  indicates  whenever  the  first 
or  fourth  Purkinje  tracker  is  unlocked  for  any  reason. 
The  signal  can  be  used  to  ignore  those  portions  of  the 
eye  records  in  manual  or  automatic  processing  of  the 
data. 


IV.  Optometer  principles 

A.  General 

Reference  1  describes  the  basic  form  of  the  optometer 
that  is  combined  with  the  double-Purkinje-image 
eyetracker  in  the  3-D  instrument.  In  this  section,  we 
discuss  the  basic  principles  of  the  optometer. 

Figure  7  is  an  optical  diagram  of  the  eye  viewing  a 
point  source  through  a  small  aperture.  In  Fig.  7(a),  the 
refractive  power  of  the  cornea  and  lens  are  such  that  the 
point  is  sharply  imaged  on  the  retina.  In  this  case,  if  an 
aperture  were  moved  from  position  A  to  position  B, 
different  bundles  of  rays  from  the  source  would  strike 
the  retina,  but  the  illuminated  retinal  spot  would  be 
stationary.  In  Fig.  7(b),  the  refractive  power  of  the  eye 
is  too  small,  and  the  retinal  spot  moves  from  position 
A'tofl'in  response  to  aperture  movement  from  A  to  B. 
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Fig-  7.  Imaging  a  point  target  at  infinity  through  a  small  aperture 
that  alternates  between  two  positions,  A  and  B.  The  intercepted-ray 
position  at  the  retina  will  he  stationary  or  will  move  with  or  move 
opposite  to  the  aperture,  respectively,  according  to  whether  the  eye 
is  focused  for  infinity  (a),  beyond  infinity  (b),  or  closer  than  infinity 
(c). 

Conversely,  in  Fig.  7(c),  the  refractive  power  of  the  eye 
is  too  great,  and  the  retinal  spot  moves  from  A'  to  B' 
(i.e.,  in  the  opposite  direction)  in  response  to  aperture 
movement  from  A  to  R.  The  object  plane  conjugate  to 
the  retina  can  be  found  by  changing  the  distance  of  the 
source,  according  to  the  polarity  of  the  image  move¬ 
ment,  until  the  retinal  image  is  stationary.  The  opto¬ 
meter  performs  this  function  automatically  and  con¬ 
tinuously. 

Figure  8  illustrates  the  basic  optometer  configuration. 
Instead  of  a  mechanical  aperture  positioned  close  to  the 
eye,  an  optical  projection  system  achieves  the  same  ef¬ 
fect.  Two  adjacent,  near-ir  light  sources,  S2  and  S3, 
which  have  a  narrow  spectral  band  centered  at  0.93-#tm 
wavelength,  are  located  in  the  focal  plane  of  lens  L  j.6 
An  image  of  the  light  sources  is  formed  in  the  plane  of 
the  pupil  of  the  eye,  which  is  at  the  focal  plane  of  lens 
1,2 .  The  light  sources  flicker  on  and  off  alternately  at 
a  rate  of  400  Hz.  Thus,  light  enters  the  eye  first  through 
one  small  area  of  pupil  (the  image  of  the  first  light 
source)  and  theo  through  an  adjacent  area  of  the  pupil 
(the  image  of  the  second  source).  This  is  equivalent  to 
two  alternating  aperture  positions. 

Stop  ST2,  which  is  illuminated  alternately  by  sources 
S2  and  S3,  appears  to  the  eye  at  a  virtual  distance 

I-  “  </2>/U  *  |rf/(/2)|l.  (I) 

where  L,  d,  and  /.  (the  focal  length  of  lens  L2)  are  in 
meters.  To  focus  stop  ST2  on  the  retina  requires  an 
accommodation  level 


where  Df;  is  in  diopters.  We  use  the  convention  that 
the  refractive  power  of  the  eye  is  stated  relative  to  its 
power  when  accommodated  for  infinity  (i.e.,  when  d  = 


[2,  1>e  =  0  diopters).  As  the  eye  changes  its  refractive 
power,  stop  ST2  is  maintained  in  focus  on  the  retina  by 
adjusting  d,  whose  position  is  a  direct  measure  of  the 
instantaneous  refractive  power  of  the  eye.  Note  from 
Eq.  (2)  that  Du,  measured  in  diopters,  is  linearly  related 
to  the  distance  d  measured  in  meters. 

Stop  ST 2  is  moved  along  the  optical  axis  in  response 
to  the  movement  of  the  image  of  stop  ST 2  on  the  retina. 
This  movement  is  detected  by  reimaging  the  retinal 
image  onto  a  split-field  photocell  SFP  and  sensing  lat¬ 
eral  movement  of  the  image  in  synchronism  with  the 
alternation  of  light  sources  S->  and  S3.  If  stop  ST 2  is  in 
focus  on  the  retina,  the  image  will  lie  stationary.  If  the 
image  is  out  of  focus,  it  will  appear  to  move  either  in 
phase  or  out  of  phase  with  the  alternation  of  the  light 
source,  as  illustrated  in  Fig.  7. 

The  image  formed  at  the  photocell  derives  from  light 
reflected  from  the  retina,  which  passes  back  out  through 
the  pupil  of  the  eye.  This  light  is  reflected  by  dichroic 
mirror  M  and  then  by  beam  splitter  BS.  If  ST2  is  in 
focus  on  the  retina,  lens  L%  which  is  identical  to  lens  /.2, 
forms  an  image  of  the  retinal  image  in  a  plane  that  is 
conjugate  with  stop  ST2  (i.e.,  at  plane  ft/,  which  is  at  a 
distance  d  from  lens  L 3).  For  clarity,  lens  L 3  is  drawn 
adjacent  to  lens  L2,  as  though  the  dashed  portion  W  of 
the  output  path  were  of  zero  length;  actually,  L3  is  lo¬ 
cated  at  the  same  optical  distance  from  the  eye  as  is  L2. 
Split  field  photocell  SFP  could  be  located  in  plane  ft/ 
except  that  it  is  necessary  first  to  block  the  corneal  re¬ 
flection,  which  is  much  brighter  than  the  reflected  ret¬ 
inal  image.  Thus,  the  image  in  plane  ft/  is  relayed  by 
a  pair  of  fixed  lenses  L4  and  Lg.  With  L4  and  ft  5  sepa¬ 
rated  by  a  distance  equal  to  twice  their  focal  length,  the 
retinal  image  formed  in  plane  ft/  is  relayed  a  distance 
equal  to  four  focal  lengths  (see  next  section),  as  shown 
in  Fig.  8,  in  which  plane  SFP  is  located.  An  image  of 
the  plane  of  the  pupil  is  obtained  in  the  focal  plane  of 
lens  L  4,  which  is  conjugate  also  to  the  plane  of  the  light 
sources  S2  and  S3.  A  small  corneal  stop  (CS)  placed  in 
this  plane  blocks  the  very  small  but  bright  corneal  re¬ 
flection  of  sources  S  >  and  S3. 
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Fig.  8.  Basic  optometer  arrangement:  S2  and  ,S3,  IRI.EDs;  ST2. 
stop  that  is  imaged  cn  the  retina:  M,  dichroic  mirror;  BS,  beam 
splitter;  CS,  corneal  stop:  SFP,  split-field  photocell.  ST?  and  SFP 
are  linked  mechanically  to  slide  SM  The  number  of  diopters  of  ac¬ 
commodation  required  by  the  eye  to  focus  on  ST2  is  linearly  related 
to  the  distanced  between  ST2  and  l,'i  When  ST,  is  in  focus  on  the 
’vtina,  the  retinal  image  is  also  reimaged  at  plane  Rl,  which  i«  relayed 
by  fixed  lenses  /.<  and  l,5  to  the  plane  of  SFP  For  simplicity.  L*  is 
drawn  opposite  l.2,  although  the  entire  output  path  should  be  shifted 
to  the  left  by  the  distance  W. 
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Stop  ST>  and  the  SFI1  are  mechanically  linked. 
Thus,  when  stop  ST/  is  in  focus  on  the  retina,  the  retinal 
image  will  be  conjugate  with,  and  therefore  stationary 
on,  the  split-field  cell.  If  S'l'2  is  out  of  focus,  movement 
of  the  image  on  the  retina  in  one  phase  or  the  other  will 
drive  the  slide  SM  in  the  appropriate  direction  until  the 
error  signal  is  zero,  and  the  image  is  stationary  on  the 
retina  and  therefore  on  the  photocell.  If  the  servosys- 
tem  has  a  faster  response  than  the  accommodation 
system  of  the  eye,  the  instantaneous  posit  ion  of  the  slide 
(i.e.,  distance  d)  will  provide  an  accurate  measure  of  the 
instantaneous  refractive  power  of  the  eye. 

B.  Optometer  Range 

From  Eq.  (2),  we  see  that  /)/..  =  1  lf  >,  when  d  =  0. 
Thus,  the  maximum  measurable  diopters  is  equal  to  the 
focal  length  (in  diopters)  of  lens  l.-,.  To  measure  an 
accommodation  level  up  to  +20  diopters,  for  instance, 
lens  L-i  would  require  a  focal  length  of  I /20th  m,  or  50 
mm.  The  problem  with  such  a  short  focal  length  lens 
is  that  it  must  I)e  brought  very  close  to  the  eye,  and  there 
is  very  little  room  for  other  optical  elements  that  might 
be  needed. 

A  way  to  increase  this  distance  and  the  diopter  range 
at  the  same  time  is  to  use  an  image  of  stop  ST  >  instead 
of  the  stop  itself.  The  problem  with  a  real  stop,  of 
course,  is  that  it  cannot  pass  through  the  lens.  That  is, 
we  cannot  achieve  negative  values  of  the  distance  pa¬ 
rameter  d.  But  an  image  can  pass  through  the  lens,  and 
in  that  way  the  power  of  the  instrument  can  be  in¬ 
creased  beyond  the  power  of  lens  L  >.  [Equation  (2) 
holds  exactly  even  for  negative  values  of  d.]  This  fact 
is  important  in  combining  the  eyetracker  and  opto¬ 
meter,  which  is  discussed  in  the  next  section. 

V.  Combined  Three-Dimensional  Instrument 

The  major  task  in  building  a  composite  instrument 
was  to  combine  an  optometer  instrument  of  the  form 
shown  in  Fig.  8  with  the  eyetracker  shown  in  Fig.  4.  To 
help  the  reader  appreciate  how  the  merging  was 
achieved,  we  must  discuss  briefly  a  certain  basic  feature 
of  a  telescope. 

The  simplest  telescope  consists  of  a  pair  of  positive 
lenses  separated  by  a  distance  equal  to  the  sum  of  their 
focal  lengths.  Although  telescopic  systems  have  un¬ 
dergone  extensive  study  and  many  practical  develop¬ 
ments,  here  we  are  concerned  only  with  certain  prop¬ 
erties  and  uses  of  the  telescope  as  a  relay  system. 

With  a  pair  of  lenses  separated  by  the  sum  of  their 
focal  lengths,  it  is  easy  to  show  that  the  object  and  image 
distances,  p  and  q,  measured  from  each  lens,  as  shown 
in  Fig.  9,  have  the  following  linear  relationship: 

where  / 1  and  f2  are  the  focal  lengths  of  the  two  lenses. 
As  a  result,  both  the  axial  magnification  (Aq/Ap)  and 
the  lateral  magnification  (M  =  /2//1)  are  constant,  in¬ 
dependent  of  distance  p.  Although  apparently  not  well 
known,  it  is  therefore  possible  with  this  configuration 
(for  the  case  f2  -  j \)  to  achieve  imaging  with  neither 


Fij*  !).  THesrojM*  ronf  ifcTiration.  With  two  lenses  separated  by  the 
sum  of  their  focal  lengths,  the  object  and  image  distances,  p  and  </, 
are  linearly  related,  and  lateral  magnification  is  independent  of  p. 


Fig.  1(1.  Merging  the  twu  instruments.  The  instruments  are  merged 
I'V  means  of  beam  splitter  HS,  ET.  remainder  of  the  eyetracker 
system;  HSC,  polarizing  beam  splitter  cube;  Sj  and  S3,  IRLEDs;  M»>, 
90°  mirror  that  merges  the  images  of  ,S'Z  and  S3;  ST 3,  stop  that  is 
imaged  on  the  retina;  IH/.  adjustable  iris  conjugate  with  the  eye  pupil 
plane;  C;„  split-field  photocell  on  which  the  retinal  image  falls;  CS, 
corneal  stop;  POL-t  and  polarizers  that  reinforce  the  input  and 
output  polarization  directions  of  HSC;  ST,t  and  Pt,  are  linked  me 
chanicallv  to  slide  SM 

axial  nor  lateral  distortion  (at  least  to  a  first-order  ap¬ 
proximation);  compare  this  case  with  single-lens 
imaging,  in  which  axial  and  lateral  magnification  both 
vary  with  the  object-to-lens  distance  (see  Fig.  3  of  the 
accompanying  paper7). 

Of  specific  interest  to  this  discussion  is  that  the  object 
and  image  distances  are  linearly  related,  even  for/2  s* 
f\.  In  fact,  just  as  Eq.  (2)  is  true  for  an  object  on  the  far 
side  of  the  lens  (negative  values  of  d),  so  too  it  is  readily 
shown  that  Eq.  (3)  is  true  for  an  object  (or  an  image  of 
an  object)  that  falls  between  the  two  lenses  of  Fig.  9  and 
even  beyond  the  right-hand  lens  (i.e.,  negative  values 
of  p).  Thus,  a  telescopic  relay  in  the  optometer  path 
does  not  alter  the  linear  relation  between  eye  diopters 
and  the  movement  of  stop  ST2. 

In  Fig.  4,  lenses  L-;  and  /,«  together  form  a  unity 
magnification  image  of  the  Purkinje  reflections  at 
mirror  Mm,  which  is  the  focal  plane  of  lens  L9.  Ixtoked 
at  another  way,  lens  I.7  is  a  focal  distance  from  the  pupil 
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plane  of  the  eye  and  plays  the  role  of  lens  L2  in  Pig.  8, 
while  lenses  Lg  and  L9,  which  are  separated  by  the  sum 
of  their  focal  lengths,  together  form  a  (nonunity  ratio) 
telescope  system.  By  merging  the  optometer  with  the 
eyetracker  on  the  distal  side  of  lens  Lg  as  viewed  from 
the  eye,  we  benefit  from  the  first-Purkinje- image  sta¬ 
bilization  provided  by  mirror  M10,  while  maintaining 
the  linear  relation  of  Eq.  (2)  between  eye  diopters  and 
servo  motion.  We  can  also  obtain  a  large  diopter  range 
even  though  lens  L7  is  of  relatively  long  focal  length;  see 
Sec.  IV.B.  The  main  disadvantage  of  this  scheme  is  that 
lenses  L7,  Lg,  and  Lg  are  now  common  to  the  input  and 
output  paths  of  the  optometer.  Any  reflection  of  op¬ 
tometer  input  light  from  these  lens  surfaces  that  enters 
the  optometer  output  path  can  cause  serious  artifact 
signals  because  the  total  light  reflected  from  the  fundus 
of  the  eye  is  extremely  small.  Elimination  of  these  re¬ 
flections  requires  special  care. 

A  schematic  of  the  composite  instrument  is  shown  in 
Fig.  10.  The  two  instruments  are  merged  via  beam 
splitter  BS*.  which  is  mounted  between  lens  Lg  and 
beam  splitter  BS\  (see  Fig.  4).  Although  BS4  reflects 
the  optometer  light  at  right  angles  to  the  plane  of  the 
paper  of  Fig.  4,  BSA  is  shown  as  transmitting,  rather 
than  reflecting,  so  the  optometer  and  relevant  ey¬ 
etracker  optics  can  be  drawn  in  a  single  plane. 


A.  Optometer  Input  Path 

Light  sources  S2  and  S3  are  imaged  by  lens  pairs  L20 
and  L2 1  onto  a  right-angle  mirror  Mm,  which  causes  two 
half-disks  of  light  to  appear  side  by  side,  as  shown  in  the 
lower  inset  to  Fig.  10.  The  two  half-disks  of  light  are 
energized  out  of  phase.  An  image  of  this  flickering  light 
pattern,  which  is  in  the  focal  plane  of  lens  LM,  is  formed 
on  iris  diaphragm  IRg  located  in  the  focal  plane  of  lens 
£.23  and  also  in  the  focal  plane  of  lens  Z.24.  (Lenses  Z.23 
and  £.24,  which  are  identical  and  are  separated  by  twice 
their  focal  length,  form  a  unity  ratio  relay  lens.)  An¬ 
other  image  of  the  light  sources  S2  and  S3  is  thus  formed 
on  mirror  Mu,  which,  as  explained  earlier,  is  conjugate 
to  the  pupil  plane  of  the  eye.  The  diameter  of  the  light 
source  pattern  at  the  eye  pupil  plane  is  adjustable  by 
means  of  iris  IR2  (see  inset,  Fig.  10). 

Stop  ST3  and  lens  £.7  together  are  functionally 
equivalent  to  stop  ST2  and  lens  L2  in  Fig.  8,  except  that 
they  are  separated  by  two  relay  lens  pairs,  (Lg,  Lg)  and 
(£-21.  L 24),  in  series.  (Relay  lens  pairs  in  series  have  the 
same  linearity  properties  as  a  single  lens  pair.)  With 
stop  STg  positioned  so  that  its  image  is  in  the  focal  plane 
of  Lg,  light  from  ST3  reaching  lens  pair  £.7  and  Lg  is 
collimated,  and  another  image  of  ST3  is  formed  halfway 
between  £.7  and  the  eye,  a  distance  £7/2  from  the  eye 
(which  represents  nine  diopters  of  refractive  power). 
As  ST3  moves  farther  from  (or  closer  to)  £.23,  the  final 
image  moves  farther  from  (or  closer  to)  the  eye,  i.e.,  to 
a  position  of  less  (or  more)  dioptric  power. 

Stop  ST 9  is  a  narrow  slit  with  its  center  blocked  (see 
the  inset  on  the  left  of  Fig.  10).  The  reason  for  blocking 
the  center  is  that  very  bright,  on-axis,  input  light  would 


be  reflected  directly  back  by  mirror  Mu  (after  reflection 
from  Afn  to  M)0  and  then  back  toward  Lg)  and  could 
cause  a  serious  artifact  in  the  optometer  output  sig¬ 
nal. 


B.  Optometer  Output  Path 

Lenses  L2s  and  Lm  are  conjugate  with  lenses  L24  and 
L2 3,  respectively.  A  corneal  stop  CS  is  located  in  a 
plane  conjugate  with  iris  IR2.  If  stop  ST3  is  in  focus  on 
the  retina,  an  image  of  the  retinal  image  is  formed  at  a 
distance  d  from  lens  L2«-  The  split-field  cell  P3  is 
placed  in  this  plane,  as  shown  in  Fig.  10.  If  ST3  is  out 
of  focus  on  the  retina,  its  image  on  the  retina  moves  in 
synchronism  with  S2  and  S3.  This  side-by-side  motion 
is  detected  by  Pg,  and  the  resulting  signal  drives  the 
slide  containing  ST3  until  the  retinal  image  is  again 
stationary. 

Potentially  large  artifact  signals  can  be  generated  in 
the  optometer  output  by  specular  reflections  of  opto¬ 
meter  input  light  from  lenses  L7,  Lg,  Lg,  and  the  cornea, 
which  are  common  to  the  input  and  output  paths  of  the 
optometer.  This  potentially  serious  artifact  is  elimi¬ 
nated  by  polarizing  the  optometer  input  light  with  a 
polarizing  beam  splitter  cube  BSC.  Any  specularly 
reflected  light  from  lenses  L7,  Lg,  Lg,  and  the  cornea  has 
the  same  polarization  as  the  input  light  and,  therefore, 
will  not  be  reflected  into  the  optometer  output  path,  but 
will  pass  directly  back  through  the  BSC. 

Polarizers  POL2  and  POL3,  shown  in  the  optometer 
input  and  output  paths  in  Fig.  10,  are  not  logically 
necessary,  although  they  are  important  for  proper 
functioning.  Polarizer  POL2  blocks  the  input  light  that 
would  normally  be  reflected  by  BSC,  thus  substantially 
reducing  the  magnitude  of  light  that  may  be  rereflected 
from  the  external  surface  of  BSC  and  that  could  reenter 
the  output  path.  Further,  because  BSC  is  not  a  perfect 
polarizer,  a  certain  amount  of  light  is  also  scattered  at 
its  diagonal  interface.  POL3  significantly  reduces  the 
amount  of  scattered  light  that  enters  the  output. 


C.  Optical  Isolation  between  the  Two  Instruments 
Eyetracker  light  is  blocked  from  the  optometer  by 
enlarging  the  corneal  stop  CS  in  the  optometer  output 
path.  The  inset  on  the  right  of  Fig.  10  shows  the  Pur- 
kinje  reflection  from  the  optometer,  labeled  ST3,  and 
from  the  eyetracker,  labeled  1st  and  4th.  The  BSC 
prevents  most  of  the  optometer  light  that  is  reflected 
from  the  cornea  from  reentering  the  output  path  of  the 
optometer.  However,  this  reflected  light  is  so  bright 
that  it  is  still  necessary  to  use  a  corneal  stop  CS  that  is 
large  enough  to  block  the  corneal  image  of  ST3.  By 
enlarging  the  stop,  as  shown  in  the  inset  in  Fig.  10,  light 
from  the  first  and  fourth  images  from  the  eyetracker  is 
also  blocked.  The  stabilizing  action  of  the  eyetracker 
keeps  the  comeal  reflection  blocked  by  the  stop  CS  even 
under  conditions  of  eye  rotation  and/or  trans.  tion. 
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Fig.  11.  Subject  configuration  for  stimulating  and  recording  3  D  eye 
movements:  3D-RT,  3-D  eyetracker,  which  includes  dichroic  mirror 
PC;  VS.  3-D  visual  stimulator;  T,  target. 


D.  Electrical  Isolation  of  the  Instruments 

Most  of  the  eyetracker  light  is  eliminated  from  the 
optometer  by  the  enlarged  corneal  stop  as  noted  above. 
In  the  eyetracker,  the  effects  of  a  bright  corneal  image 
of  the  optometer  input  falling  on  top  of  a  weak  fourth 
Purkinje  image  (in  certain  directions  of  gaze)  are  elim¬ 
inated  by  a  high-pass  electrical  filter,  which  creates  a 
single  sideband  system  for  the  4-kHz  eyetracker  signal. 
This  filter  eliminates  any  400- Hz  signals  from  the 
eyetracker  channels.  A  combination  of  low-pass  and 
bandpass  filters  removes  from  the  optometer  signal  any 
residual  4-kHz  eyetracker  signals. 

VI.  Performance 


B.  Three-Dimensional  Records 
Single-eye  recordings  are  adequate  to  illustrate  the 
basic  response  of  the  instrument.  In  Fig.  13,  the  right 
eye  was  occluded,  and  the  left  eye  VS  caused  a  fixation 
target  to  be  moved  simultaneously  in  a  aa  vtooth  pattern 
vertically  and  in  a  sine-wave  pattern  horizontally  both 
8°  peak  to  peak.  At  the  same  time,  the  focus  stimulator 


Fig.  1 2.  The  3-D,  binocular  arrangement. 
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A.  Binocular  Configuration 

Figure  1 1  shows  a  binocular  configuration  with  which 
the  records  of  this  section  were  taken.  Fach  eye  views 
a  target  T  through  a  dichroic  mirror  (mirror  Mg  in  Fig. 
4)  and  a  3-D  visual  stimulator  VS.  By  means  of  three 
servocontrolled  mirror  and  lens  systems,  VS  can  move 
the  visual  field  horizontally  and  vertically  indepen¬ 
dently  and  can  vary  the  optical  distance  of  the  target 
without  changing  its  brightness  or  size.7  The  VS  also 
provides  a  location  for  an  artificial  pupil,  if  desired. 
Movements  of  each  eye  are  monitored  by  a  separate  3-D 
eyetracker.  Two  such  stimulator  and  eyetracker  in¬ 
struments  aligned  side  by  side  in  a  binocular  configu¬ 
ration  provide  independent  visual  stimulation  and  re¬ 
cording  from  each  eye.  Figure  1 2  is  a  photograph  of  a 
pair  of  3-D  eyetrackers  and  visual  stimulators  arranged 
in  such  a  binocular  configuration. 

The  focus  stimulator  portion  of  VS  can  be  used  as  a 
focus  corrector  for  subjects  who  normally  wear  glasses. 
Although  the  eyetracker  has  been  operated  with 
subjects  wearing  glasses,  it  is  not  the  preferred  method 
of  operation.  The  VS  can  adjust  spherical  poweT  to  suit 
the  subject,  and  cylinder  power  can  be  corrected  with 
standard  ophthalmic  cylinder  lenses  inserted  near  the 
artificial  pupil  plane. 
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Fig-  13.  3-D,  monocular  recording  made  while  the  subject  tracked 
a  target  moving  horizontally  according  to  an  8°  sine  wave,  vertically 
according  to  an  8°  sawtooth  of  different  frequency,  and  in  focus  ac¬ 
cording  to  a  3-diopter  square  wave  of  still  another  frequency  (right 
eye  occluded). 
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altered  the  optical  distance  to  the  target  between  in¬ 
finity  (zero  diopters)  and  a  third  of  a  meter  (three 
diopters),  according  to  a  square-wave  pattern.  That 
is,  the  target  movement  in  each  dimension  was  inde¬ 
pendent  of  the  form  and  frequency  of  the  movement  in 
the  other  dimensions. 


C.  Eyetracker  and  Optometer  Response 
The  noise  level  in  the  X  and  Y  channels  of  the  3-D 
eyetracker  is  less  than  1  min  of  arc  rms.  The  allowable 
range  of  eye  movements  varies  from  subject  to  subject, 
depending  primarily  on  pupil  size.  A  range  of  at  least 
20°  is  achieved  easily  with  most  subjects.  The  opto¬ 
meter  has  a  range  from  -4  to  + 12  diopters  and  a  noise 
level  of  approximately  0.1  diopter. 
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Figure  14  is  a  2- D  field  plot  of  the  eyetracker  made 
with  an  X — Y  recorder.  The  X  and  Y  inputs  were 
driven  directly  from  the  horizontal  and  vertical  outputs, 
Ht  and  V4,  of  the  fourth  Purkinje  tracker.  For  this  plot, 
the  subject  moved  his  fixation  voluntarily  around  a  9- 
by-9  matrix  of  bright  points  spaced  2°  apart.  The 
subject  fixated  on  each  point  for  several  seconds;  the 
pen  was  deenergized  between  fixation  points. 

Although  there  is  a  field  distortion  over  large  eye 
movements,  repeatability  is  a  few  min  of  arc,  that  is,  the 
plot  retraces  itself  to  that  degree  of  accuracy  even  if  the 
subject  gets  off  the  biteboard  between  plots. 

The  horizontal  and  vertical  servoes  have  a  frequency 
response  approximately  fiat  to  300  Hz  and  a  maximum 
slewing  rate  greater  than  1000°/sec.  Figure  15  shows 
the  eye  response  to  a  diagonal  step  change  having  4° 
horizontal  and  vertical  components.  Note  that  the 
horizontal  velocity  in  the  first  saccade  is  almost  twice 
that  of  the  vertical  velocity — 200°/sec  vs  100° /sec.  The 
servoes  also  have  a  lag  of  approximately  1  msec,  which 
results  in  a  6-min  of  arc  lag  when  tracking  an  eye 
movement  of  100°/sec. 

The  dynamic  response  and  the  noise  level  of  the 
eyetracker  are  adequate  to  achieve  a  stabilized-image 
disappearance  of  moderate  contrast  targets  when  the 
eyetracker  signals  are  used  to  drive  a  CRT  so  that  its 
pattern  tracks  the  eye  movements  and  thereby  stabilizes 
the  image  on  the  retina.8  Good  disappearance  capa¬ 
bility  has  also  been  demonstrated  using  the  3-D  stim¬ 
ulator  to  stabilize  a  fixed  visual  pattern  in  space. 
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Fig.  14.  Two-dimensional  field  plot;  spacing  between  spots  is  2°. 
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Fig.  15.  Simultaneous  horizontal  and  vertical  eye  movements, 
showing  the  general  form  of  the  response.  Note  the  difference  in 
h orizontsi  and  vertical  eye  movement  velocities  during  the  saccade. 
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Fig.  16.  Bye  movement  in  response  to  heartbeat.  Thene  illustrate 
the  sensitivity  of  the  instrument  in  detecting  3-D  translational  as  well 
as  rotational  motions  of  the  globe,  (a),  (b)  Axial  eye  motion  and 
simultaneous  KKG;  horizontal  eye  motion  (c)  before  and  (d)  after 
exerciae. 


43 


1  March  1978  /  Vot.  17,  No.  5  /  APPLIED  OPTICS  701 


O.  Translation  Sensitivity 

The  primary  achievement  of  the  Purkinje  eyetracker 
is  separation  of  the  translation  and  rotation  components 
of  eye  motion,  as  illustrated  in  the  records  of  Pig.  3. 

Although  the  eye  rotation  records  are  nominally  in¬ 
dependent  of  any  translation  motions  of  the  eye,  they 
are  not  completely  independent  over  large  translation 
motions.  Moving  the  head  laterally  by  ±0.5  mm,  which 
would  cause  an  eye  movement  artifact  of  approximately 
±5°  with  a  corneal  tracker,  can  result  in  an  artifact 
signal  of  several  min  of  arc.  Translation  sensitivity  to 
axial  motion  can  be  of  similar  size — several  min  of  arc/ 
mm  of  axial  movement  of  the  eye.  With  the  eye  relaxed 
to  infinity,  the  optometer  output  can  change  by  ap¬ 
proximately  0. 1  -0.2  diopter/mm  of  head  movement  in 
any  direction.  The  source  of  this  residual  translation 
sensitivity  has  not  been  completely  explored,  so  it  is  not 
clear  how  much  further  this  residual  interaction  can  be 
reduced. 

The  sensitivity  of  the  instrument  in  detecting 
translation  motions  is  illustrated  in  Fig.  16.  Part  (a)  of 
Fig.  16  illustrates  axial  eye  motions  recorded  from  the 
focus-detector  diodes  PA  and  P«  of  Fig.  4,  with  the  focus 
servo  inactivated.  A  simultaneous  RKG  recording,  Fig. 
16(b),  verifies  that  the  repetitive  pattern  is  that  of  the 


heartbeat  Figure  16(c )  shows  a  recording  from  the  first 
Purkinje  (horizontal)  channel  with  the  subject  relaxed 
to  infinity  and  voluntarily  suppressing  saccades.  The 
heartbeat  pattern  does  not  show  in  the  simultaneous 
fourth  Purkinje  record  (not  shown),  indicating  that  the 
record  is  a  pure  translation  motion  of  the  eye  (of  ap¬ 
proximately  30  pm),  or  a  rotation  component  that  is  too 
small  to  see  in  the  fourth  Purkinje  record.  After  vig¬ 
orous  exercise,  both  the  rate  and  the  amplitude  of  these 
eye  translation  motions  increase,  as  shown  in  Fig. 
16(d). 

E.  Eyetracker  Overshoots 
The  eyetracker  output  often  shows  brief  overshoots 
at  the  end  of  saccades  [see  the  lower  trace  of  Fig.  17(a)). 
The  source  of  these  overshoots  appears  to  be  relative 
lateral  motion  of  the  lens  within  the  globe,  inasmuch  as 
similar  motions  do  not  appear  at  all  or  are  much  smaller 
in  the  output  from  the  first  Purkinje  tracker  (i.e.,  in  the 
motion  of  the  first  Purkinje  image)  [see  the  upper  trace 
of  Fig.  17(a)).  If  this  is  the  correct  explanation,  we 
might  expect  the  size  of  the  overshoots  to  vary  with 
accommodation  level  (i.e.,  with  changes  in  the  physical 
configuration  of  the  suspension  of  the  eye  lens).  That 
this  is  the  case  can  be  seen  from  Figs.  17(b)  and  17(c) 
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Fig.  17.  Overshoot*  in  the  eye  movement  records 
during  saccades.  As  discussed  in  the  text,  these 
seem  to  he  caused  by  lateral  motions  of  the  eye  lens 
within  the  globe,  (a)  Simultaneous  records  from  the 
first  and  fourth  Purkinje  image  tracking  systems. 
Note  the  small  overshoot*  in  the  first  Purkinje  rec 
ord  and  the  large  (and  inconsistent)  overshoot*  in 
the  fourth  Purkinje  record.  The  100  200  msec  drift 
in  the  first  Purkinje  record,  following  each  saccade, 
may  be  caused  by  a  translation  motion  of  the  eye, 
inasmuch  as  a  similar  component  is  not  seen  in  the 
fourth  Purkinje  record;  (b),(c)  comparing  simulta 
neous  horizontal  and  vertical  overshoot  component* 
in  the  fourth  Purkinje  records  with  the  subject  re 
taxed  to  infinity  and  accommodated  to  4  diopters 
Note  the  large  increase  in  overshoot*  at  4  diopters. 
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which  shows  the  horizontal  and  vertical  eye  movement 
response  to  a  diagonal  target  movement  having  4° 
peak-to-peak  components.  In  Fig.  17(b),  the  eye  was 
relaxed  to  infinity,  and  in  Fig.  17(c),  the  eye  was  ac¬ 
commodated  to  4  diopters.  At  4  diopters  of  accom¬ 
modation,  the  limit  for  this  subject,  there  is  a  large  in¬ 
crease  in  the  size  and  time  constant  of  the  overshoots 
in  both  the  horizontal  and  vertical  channels,  as  com¬ 
pared  with  relaxed  accommodation.  Still  larger  over¬ 
shoots  have  been  seen  in  subjects  with  larger  accom¬ 
modation.  Note  that  the  overshoots  are  not  consistent 
from  saccade  to  saccade,  adding  to  the  evidence  that  the 
overshoots  are  not  in  the  instrument  servoes.  Also,  the 
overshoots  are  generally  larger  in  the  horizontal  than 
in  the  vertical  direction  for  this  subject. 

If  these  overshoots  derive  from  lateral  motion  of  the 
lens  within  the  globe,  they  provide  a  potentially  useful 
method  of  measuring  this  motion.  Also,  such  a  motion 
causes  a  shift  in  the  visual  axis  of  the  eye  and,  therefore, 
a  shift  in  the  retinal  image.  A  large  shift  can  have  sig¬ 
nificant  effects,  for  example,  on  the  quality  of  image 
stabilization.  We  have  estimated  that  the  overshoots 
in  the  fourth  Purkinje  record  are  approximately  ten 
times  as  large  as  the  resulting  shift  in  the  visual  axis, 
that  is,  a  lateral  shift  of  the  lens  large  enough  to  cause 
a  1°  overshoot  in  the  fourth  Purkinje  record  would  ac¬ 
tually  represent  about  a  6-min  shift  in  the  visual  axis  of 
the  eye. 

If  the  magnitude  of  the  overshoot  could  be  scaled 
properly,  the  tracker  would  have  an  advantage  in  image 
stabilization  over  contact  lens  methods,  which  are  in¬ 
sensitive  to  internal  movements  of  the  lens  within  the 
globe. 


The  stabilized  image  experiments  referred  to  earlier8 
were  performed  without  compensating  for  these  over¬ 
shoots,  implying  that  even  better  image  stabilization 
might  result  from  proper  compensation  of  the  overshoot 
signals  to  make  them  correspond  to  the  actual  image 
displacement. 

F.  Binocular  Records 

Figure  18  shows  simultaneous  3-D  recordings  of  both 
eyes.  During  this  record,  both  eyes  were  stimulated  by 
square  wave  accommodation  stimuli  of  2  diopters.  The 
accommodation  responses  are  shown  in  the  records  la¬ 
beled  Al  and  Ar.  During  period  A,  both  eyes  saw  a 
target  that  was  stationary  except  for  a  change  in  optical 
distance,  and  the  eyes  were  nominally  stationary  (that 
is,  the  accommodation  response  was  not  accompanied 
by  the  usual  vergence  response).  During  period  B,  the 
left  eye  was  occluded;  recordings  then  showed  the  fa¬ 
miliar  vergence  movement  in  response  to  the  accom¬ 
modation  change.  The  lower  trace,  labeled  Hr  —  Hi, 
is  the  difference  between  the  left  and  right  horizontal 
channels  and  therefore  measures  vergence.  During 
period  C,  both  eyes  again  saw  a  fixed  target. 

During  periods  D  and  F,  the  targets  in  both  eyes  were 
made  to  move  in  a  sinusoidal  pattern  horizontally  and 
sawtooth  pattern  vertically.  Note  that  the  records 
during  these  periods  are  similar  to  those  of  Fig.  13,  ex¬ 
cept  that  both  eyes  are  recorded  simultaneously. 
During  period  E,  the  left  eye  was  again  occluded,  and 
the  Hi  channel  shows  that  the  left  eye  responds  now 
with  both  the  accommodation-driven  vergence  stimuli 
and  the  sine  wave  motion  of  the  right  (seeing)  eye, 
driven  by  the  yoked  version  response. 


Fig.  18.  3-D,  binocular  record:  Hl,Hr,  horixontal 
motion  in  the  left  and  right  eye;  Vl.Vr,  vertical 
motion  in  left  and  right  eye;  Al.Ar,  accommodation 
L  in  left  and  right  eye;  Hr  -  Hi.,  difference  in  hori¬ 
zontal  motions  in  the  two  eyes  (i.e.,  vergence)  (see 
text  for  details). 
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G.  Channel  Interaction 

We  have  not  yet  studied  in  detail  the  effects  of  large 
eye  movements  on  the  calibration  of  the  optometer  and 
the  effects  of  large  accommodation  changes  on  the  cal¬ 
ibration  of  the  eyetracker.  The  records  of  Figs.  13  and 

18  show  that  these  effects  are  small,  however,  for  ordi¬ 
nary  eye  movements  and  accommodation  changes. 

Nevertheless  there  are  residual  interactions.  Figure 

19  shows  the  3-D  response  to  a  horizontal,  then  vertical, 
and  then  accommodation  square-wave  stimulus.  There 
is  almost  no  cross  coupling  into  the  other  channels 
during  the  first  two  responses,  although  there  is  some 
coupling  into  the  horizontal  channel  during  the  ac¬ 
commodation  response.  We  do  not  yet  know  for  sure 
how  much  of  this  coupling  is  in  the  eyetracker  and/or 
stimulator  and  how  much  is  in  the  eye,  because  there  is 
some  variation  in  cross  coupling  effects  from  subject  to 
subject  and  even  with  the  same  subject  from  one  session 
to  another. 

VII.  Discussion 

This  instrumentation  is  relatively  complex  and  op¬ 
erates  on  extremely  low  signal  levels  (especially  the 
signals  from  the  fourth  Purkinje  image  of  the  2-D 
eyetracker  and  from  the  retina  in  the  optometer). 
Merging  the  two  instruments,  to  achieve  a  3-D  tracker, 
required  optical  and  electronic  isolation  measures  so 
that  the  instruments  would  not  interfere  with  each 
other.  Furthermore,  the  latest  version  of  the  instru¬ 
ment  is  designed  to  tolerate  head  movements  within  1 
cm3  of  space.  This  required  developing  a  method  of 
translating  the  input  light  beams  (without  any  rotation 
components)  and  an  automatic  focus  system  (without 
any  accompanying  change  in  magnification),  as  dis¬ 
cussed  in  connection  with  Fig.  4.  The  resulting  3-D 
instrument  has  high  accuracy  and  good  frequency  re¬ 
sponse  in  all  channels  although  there  is  a  small  amount 
of  channel  interaction — especially  between  horizontal 
eye  movements  and  accommodation.  There  is  also  a 
very  small  amount  of  translation  artifact  present  in  the 
eye  rotation  records.  With  further  study  and  evolution, 
we  hope  to  be  able  to  define  the  ultimate  limits  of  this 
visual  tracking  technique. 


VIII.  Summary 

We  have  described  a  3-D  eyetracker  that  simul¬ 
taneously  tracks  the  horizontal  and  vertical  move¬ 
ments  of  the  eye  as  well  as  its  instantaneous  refractive 
power.  The  instrument  is  a  synthesis  of  two  previously 
described  instruments:  a  double-Purkinje-image 
eyetracker  and  an  optometer.  The  light  sources  for 
both  instruments  are  near  ir  (0.93  fim)  and  are  invisible 
to  the  subject.  The  eyetracker  ha9  a  frequency  response 
flat  to  approximately  300  Hz  and  operates  over  a  field 
of  more  than  20°  in  diameter.  The  noise  level  of  the 
eye-movement  records  is  approximately  1  min  of  arc. 
Good  stabilized-image  disappearance  has  been  achieved 
by  moving  the  stimulus  with  the  eyetracker  output 
signals,  which  provides  an  indication  of  the  accuracy 
and  dynamic  response  of  the  instrument.  The  opto¬ 
meter  operates  over  a  range  of  16  diopters  with  a  noise 
level  on  the  order  of  0.1  diopter. 

The  instrument  is  easy  to  use;  most  new  subjects  can 
be  aligned  within  a  few  minutes,  and,  once  aligned,  no 
adjustments  are  required  as  the  subject  moves  in  and 
out  of  the  instrument.  The  instrument  is  designed  to 
tolerate  variations  in  head  position  within  1  cm3;  signals 
indicating  the  3-D  position  of  the  eye  are  also  avail¬ 
able. 

A  pair  of  3-D  eyetrackers,  combined  with  a  pair  of  3-D 
visual  stimulators,  form  the  basis  of  a  binocular  system 
in  which  each  eye  can  be  stimulated  in  X,  Y,  and  focus 
independently,  while  the  3-D  eye  movements  are  re¬ 
corded  simultaneously  from  both  eyes. 

The  detailed  optical  design  of  the  second -generation 
eyetracker  portion  of  the  3-D  instrument  was  mainly  the 
work  of  R.  E.  Savoie.  The  authors  are  indebted  to 
Michael  Clark  for  his  general  help  in  the  later  stages  of 
the  development  and  in  obtaining  the  records  described 
in  the  section  on  performance. 

The  work  of  merging  the  optometer  and  the  improved 
double-Furkinje-image  eyetracker  was  supported  by 
NIH  grant  EY  01031  from  the  Department  of  Health, 
Education,  and  Welfare. 
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measurement  channel.  With  a  vertical  eye  movement,  mirror  M 
rotates  around  axis  aa  (see  inset  in  Fig.  2)  to  keep  the  first  Purkinje 
image  fixed  on  photocell  P |.  This  movement  causes  a  rotation  of 
the  optical  field  around  the  first  Purkinje  image,  producing  arti- 
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flection  at  mirror  Mm. 
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'  ,  jpmHtct  with  the  fir*t  generation  eyetracker  showed  that  a 
ctator  pmrtad  2  l)  rnimw  system  »  more  accurate  than  a  system 
that  artuafh  move*  a  photocell  in  two  dimensions  (i.e.,  photocell 
in  Fig  '21  The  new  eyetracker  therefore  has  two  similar,  2  D 
irrvnbriwfl  mirror  systems 

6  Isolation  between  instruments  would  be  improved  further  if  op 
tometer  light  sources  S7  and  Sj  emitted  light  of  a  different  wave- 
length  from  that  of  eyetracker  tight  source  S x .  The  two  instru¬ 
ments  could  then  he  isolated  by  optical  filters.  Light  emitting 
diodes  of  different  wavelengths  bright  enough  few  this  application 
are  |ust  now  becoming  available 

7  H  D  Crane  and  M  Clark,  this  seme  issue. 
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Three-dimensional  visual  stimulus  deflector 

H.  D.  Crane  and  Michael  R.  Clark 


A  3-1)  visual  stimulus  deflector  has  been  designed  so  that  a  subject  can  view  any  stimulus  pattern  or  object 
through  it,  and  the  pattern  (up  to  25°  in  diameter!  can  be  moved  over  a  range  of  40°  horizontally  and  30°  ver 
tically.  The  optical  distance  of  the  object  being  viewed  can  be  changed  over  a  15-diopter  range,  while  the 
brightness  and  visual  angle  subtended  by  the  object  remain  fixed.  Further,  the  observer  can  view  the  object 
through  a  pupil  of  any  desired  shape  and  transmittance.  Horizontal  and  vertical  movements  are  indepen¬ 
dent,  with  time  delays  of  I  msec  and  a  response  range  from  dc  to  200  Hz.  Focus  change  is  independent  of 
lateral  field  motion  and  has  a  time  delay  of  12  msec  and  a  maximum  slewing  rate  of  approximately  40  diop¬ 
ters/sec.  Two  such  devices  can  be  aligned  side  by  side  in  a  binocular  configuration  for  independent  3-D  con¬ 
trol  of  the  fixation  of  each  eye. 


I.  Introduction 

To  test  the  human  visual  system  in  a  clinical  or  re¬ 
search  setting,  it  is  often  necessary  to  move  a  target  in 
specific  ways  to  stimulate  certain  types  of  eye  move¬ 
ments  in  the  subject  (patient).  The  instrument  de¬ 
scribed  here  can  move  the  visual  stimulus  horizontally 
and  vertically,  as  well  as  stimulate  accommodation 
(focus)  by  altering  the  optical  distance  of  the  target  from 
the  subject.  The  subject  views  the  target  through  the 
deflector.  Horizontal  and  vertical  movements  and 
focus  change  are  accomplished  with  three  independent 
servosystems.  Independent,  3-D  stimulation  of  both 
eyes  is  achieved  by  two  devices  aligned  side  by  side. 

The  basic  principle  of  operation  may  be  summarized 
as  follows  (see  Fig.  1).  The  subject's  eye  is  positioned 
in  front  of  the  first  lens  pair  LPt  so  that  the  center  of 
rotation  C'R  of  the  eye  is  imaged  on  the  axis  of  rotation 
of  mirror  My.  The  two  lenses  of  LP\  are  identical  and 
separated  by  the  sum  of  their  focal  lengths.  This  pair 
of  identical  lenses  separated  by  the  sum  of  their  focal 
lengths  produces  an  undistorted  unity-magnification 
image.  Mirror  M t  is  fixed  in  position;  mirror  My  is 
rotated  by  a  closed-loop  servomotor  system  to  produce 
vertical  movement  of  the  visual  field. 

The  eye  is  imaged  a  second  time  by  lens  pair  LP2. 
Mirror  Mu  is  positioned  so  that  the  eye’s  center  of 
rotation  in  the  second  image  falls  on  the  axis  of  mirror 
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Mh  Mirror  Mh  is  rotated  by  a  second  closed-loop 
servomotor  system  to  produce  horizontal  movement  of 
the  visual  field.  With  the  axes  of  rotation  of  both 
mirrors  conjugate  to  CR,  pure  horizontal  and  vertical 
movement  of  the  visual  field  is  achieved  without  either 
translation  effects  or  image  size  changes. 

The  plane  of  the  eye’s  pupil  is  conjugate  to  a  plane 
labeled  AP  (artificial  pupil).  If  a  stop  smaller  than  the 
natural  pupil  is  placed  in  the  artificial  pupil  plane,  it 
becomes  the  limiting  aperture  of  the  system;  conse¬ 
quently,  the  effects  of  natural  pupil  changes  are  elimi¬ 
nated.  Cylindrical  and  spherical  correction  lenses  for 
each  subject  can  be  placed  in  a  trial  lens  holder  located 
in  front  of  aperture  AP.  Since  plane  AP  is  conjugate 
with  the  pupil  of  the  eye,  correction  lenses  placed  near 
plane  AP  should  have  the  same  visual  effect  as  if  they 
were  placed  directly  at  the  spectacle  plane. 

The  second  lens  pair,  LP2  is  positioned  so  that  its  first 
lens  L.\  is  located  one  focal  distance  from  plane  AP. 
Simultaneous  axial  movement  of  lens  L*,  mirror  Mh 
(with  its  servomotor),  and  mirror  M2  adjusts  the 
spherical  power  of  the  system  without  change  in  image 
position,  size,  or  brightness.  As  we  will  show,  spherical 
power,  in  diopters,  is  linearly  related  to  the  axial  posi¬ 
tion  of  the  movable  carriage,  which  can  be  adjusted 
manually  or  driven  by  a  third  servomotor.  Lenses  L\, 
Li,  La,  and  L4  are  actually  multiple-element  camera 
lenses. 


II.  Theory  of  Operation 

To  understand  the  optics  of  the  system,  a  discussion 
of  certain  properties  of  a  pair  of  lenses  separated  by  the 
sum  of  their  focal  lengths  is  necessary.  The  configu¬ 
ration  used  may  be  regarded  as  a  relay-lens  system. 
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Kin  1  Schematic  diagram  of  the  3-1)  visual  stimulator.  CR,  center 
of  rotation  of  eye;  L\,  Li,  L.\,  and  /,«,  multiple  element  camera  lenses; 
IJ\  leas  pair;  AP.  artificial  pupil;  l)S,  display  screen;  M v.  mirror  that 
rotates  the  visual  field  vertically;  A#«.  mirror  that  rotates  the  visual 
field  horizontally;  Mi,  fixed  mirror;  L4.  Mu.  and  mirror  M 2  move  in 
synchronism  to  adjust  the  optical  distance  to  the  display  screen  (see 
Fig.  8). 


from  the  second  lens  and  forms  a  second  image  at  a 
distance 


from  the  second  lens.  Substituting  Eq.  (2)  into  Eq.  (3) 
produces 

<4> 

Thus  the  image  distance  </'  is  linearly  related  to  the 
object  distance  p  through  the  constant  factor  (f-rff\)2. 
With  p  =  / 1,  Eq.  (4)  reduces  to  q’  =  ft.  It  is  straight¬ 
forward  to  show  that  the  same  results  are  true  for  p  > 
/. 

The  magnitude  of  the  lateral  magnification  M  be¬ 
tween  the  object  and  final  image  can  be  determined 
from 

M  Iv  </'|  |~P/i/(P  —  /i)  p'hUp'  ~/2>|  (5) 

Ip  p'l  Ip  P'  I 

or 


Fig.  2.  Two-lens  system.  /2.  focal  lengths  of  lenses  I,,.  l.,\  p, 
object  distance  to  /. ■;  q,  first  image  distance  from  p',  object  dis¬ 
tance  from  /.->;  q',  second  image  distance  from  I.J,  d,  separation  be¬ 
tween  /.  i  and  Li,  ,S,  separation  lielween  object  and  second  image. 


Substituting  Eq.  (2)  for  p'  results  in  the  simple  equa¬ 
tion 

M  =  f2/f„  (7) 

which  depends  only  on  the  ratio  of  the  focal  lengths  and 
is  independent  of  p. 

Because  axial  image  position  is  linearly  related  to 
object  position  and  lateral  image  magnification  is  in¬ 
dependent  of  object  distance,  axial  magnification  is 
uniform,  and  lateral  magnification  is  constant  in  the 
image  [see  Fig.  3(a)  for  the  case  of  fi/f\  =  2).  In  this 
case,  lateral  magnification  is  two,  and  axial  distances  are 
scaled  by  22  =  4.  Figure  3(b)  shows  the  usual  distortion 
that  results  from  single  lens  imaging  for  the  same 
magnification. 


A.  Linear  Object-Image  Motion 

Figure  2  illustrates  a  pair  of  positive  lenses  of  focal 
length  / 1  and  ft,  separated  hy  a  distance  d.  An  object 
at  distance  p  from  the  first  lens  (p  <  f\ )  forms  an  image 
at  distance  q'  from  the  second  lens. 

It  is  well  known  that  if  p  =  f\  then  q'  =  /2,  indepen¬ 
dent  of  the  separation  d,  and  there  is  an  image  magni¬ 
fication  M  -  f-t/fi .  I-ess  well  known  is  that  when  d  = 
/ 1  +  f  i  (i.e.,  when  the  lenses  are  separated  by  the  sum 
of  their  focal  lengths),  the  distance  p  and  q'  are  linearly 
related,  and  magnification  M  is  independent  of  p. 

For  p  <  / 1  the  image  formed  by  L\,  labeled  the  first 
image  in  Fig.  2,  will  be  virtual  and  located  at  a  dis¬ 
tance 


■»  ■  -pfi/(p  - 1,)  U) 

on  the  same  side  of  the  lens  as  the  object.  This  first 
image  is  at  a  distance 


p'  -  </  +  </i  +h) 


pft  ~  /i(/i  +  ft) 
P~ft 


(2) 


B.  Object-Image  Separation 
The  separation  S  between  the  object  and  the  second 
image  in  Fig.  2  is 


■S  =  p  +  </,  +  f.2)  +  q‘  (8) 


~  lllli  j) 

I- 

Fig.  3.  (a)  Relay  lens  pair,  lateral  and  axial  magnification  are  in¬ 
dependent  of  axial  poaition  of  the  object.  Note  the  diatortionleiw  and 
constant  imaging  from  (obcrfe)  to  (a'6'r'dV'l.  (h)  Typical  disUntion 
of  Hingle-lenn  imaging. 
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or 


n  =  m/i/  -  <*>. 


(12) 


i-  „  -I  J  ^ 


Fig.  4.  Schematic  representation  o*  a  simple  Bedel  optometer.  The 
pupil  plane  of  the  eye  is  placed  one  focal  length  /  from  lens  L\\  the 
object,  a  distance  d  from  /,  t,  subtends  a  visual  angle  20;  a  virtual  image 
of  the  object  is  formed  at  a  distance  #  from  i«i;  note  the  backward 
projection  of  central  rays  f  i  and  ('•/,  p,  pupil  diameter. 


Substituting  Eq.  (4)  for  q'  results  in 


For  p  =  ft,  Eq.  (9)  reduces  to  2(ft  +  ft).  For  f\  =  f 2  = 
f,  the  separation  is  constant  and  equal  to 


independent  of  p.  This  result  is  expected  once  it  is 
noted  that,  with  equal-power  lenses,  image  movement 
exactly  tracks  object  movement.  Alternatively,  for  a 
fixed  object  location,  the  lens  pair  itself  can  be  moved 
without  affecting  the  image  position. 

Even  if  there  is  a  nonunity  ratio,  magnification  will 
still  remain  constant  although  S  varies  linearly  with  p. 
Thus,  if  the  spacing  between  the  object  plane  and  the 
desired  image  plane  should  change,  either  because  the 
object  moved  or  because  the  image  screen  moved,  the 
system  can  be  refocused  by  moving  the  lens  pair  along 
the  optic  axis.  When  refocused,  the  image  will  be  un¬ 
changed  in  size  because  of  the  constant  magnification 
property. 

C.  Basic  Principle  of  Focus  Corrector/Deflector 

In  the  optical  system  sometimes  referred  to  as  a  Badel 
optometer,  the  eye  views  an  object  through  a  lens  that 
is  located  one  focal  length  from  the  pupil  of  the  eye,  as 
illustrated  in  Fig.  4.  (More  specifically,  the  lens  is 
placed  one  focal  length  from  the  first  nodal  point  of  the 
eye,  which  is  approximately  in  the  pupil  plane  of  the 
eye.)  The  optical  power  of  the  system  is  adjusted  by 
varying  the  distance  d  between  the  object  and  lens. 
Lens  La  of  Fig.  1,  which  is  located  one  focal  length  from 
the  first  image  of  the  pupil,  is  functionally  equivalent 
to  lens  Li  of  Fig.  4.  Movement  of  lens  L«  in  Fig.  1  varies 
the  distance  d  between  the  real  image  formed  of  the 
display  screen  US  and  lens  La-  Hence,  L3  functions  as 
a  Badel  optometer  that  is  separated  from  the  eye  by  a 
relay  lens  pair  LP\. 

Viewing  through  lens  L\  of  Fig.  4,  the  eye  sees  the 
object,  located  a  distance  d  on  the  far  side  of  the  lens, 
imaged  at  a  distance  f  +  g  from  the  lens.  As  illustrated 
by  Fig.  4, 

Mg  -  Ud-Uf  <U) 


and  therefore 

I  +  <  =  /2/</-d>.  03) 

The  distance  to  the  image  in  diopters  Du  is 

where  f  and  g  are  measured  in  meters,  and  Do  =  1  If  is 
the  dioptric  power  of  the  lens.  If  d  =  /,  the  object  ap¬ 
pears  at  infinity,  and  the  relative  power  of  the  eye  De 
required  to  focus  the  object  is  zero.1  If  cf  =  0,  the  lens 
has  no  optical  effect,  and  the  object  appears  to  the  eye 
at  the  distance  of  the  lens.  The  accommodation  power 
required  to  focus  it  is  therefore  l/f,  or  D„,  diopters.  If 
d  >  f,  the  object  appears  beyond  infinity,  and  the  re¬ 
quired  eye  power  is  negative.  Note  that  the  relation¬ 
ship  expressed  in  Eq.  (14)  between  eye  diopters  and 
distance  d  is  linear. 

The  angular  size  of  the  object  is  independent  of  d 
because  the  backward  projection  of  the  central  rays 
from  each  point  of  the  object,  for  example,  rays  Cj  and 
C2  from  the  two  extreme  points  of  the  object  are  inde¬ 
pendent  of  d.  Image  brightness  is  also  independent  of 
d  because  the  fan  of  rays  accepted  from  each  point  of 
the  object  is  independent  of  d.  To  see  this,  note  that 
the  fan  of  rays  accepted  at  the  pupil  from  object  point 
Q  has  an  angular  extent  y  as  viewed  from  the  object 
point.  Using  the  small  angle  approximation,  we  have 

■»  =  lP«/(f  +  R)\ld.  (15) 

where  p  is  the  pupil  diameter.  Substituting  Eq.  (12) 
and  Eq.  (13)  into  Eq.  (15)  results  in 


which  is  independent  of  d.  This  result  is  true  for  every 
point  of  the  object.  For  this  reason,  image  brightness 
is  independent  of  the  focal  power  of  the  instrument. 

Crane  and  Comsweet  devised  a  system,  shown  in  Fig. 
5,  that  does  not  require  the  object  to  be  moved  to  change 
the  virtual  distance  d.2  An  image  of  the  object  to  be 
viewed  is  formed  by  a  lens  L3  in  the  space  between  L\ 
and  L2.  The  distance  from  this  real  image  to  lens  L\ 
(distance  d)  is  smoothly  varied  by  means  of  a  four- 
component  mirror  system.  With  the  eye  fixed  in  the 
focal  plane  of  lens  L 1,  an  image  of  the  eye  pupil  is 
formed  in  the  focal  plane  to  the  right  of  lens  Lj.  For 
this  method  of  imaging,  the  light  coming  to  focus  at  AP 
is  collimated  between  the  lenses,  and  the  image  of  the 
eye  pupil  is  therefore  unaffected  by  movement  of  the 
mirrors.  Hence,  an  artificial  pupil  AP  can  be  used  in 
this  image  plane. 

D.  Large  Field  of  View 

Using  spherically  corrected  doublets,  a  system  of  the 
form  shown  in  Fig.  5  can  operate  well  over  a  viewing 
field  up  to  about  10°.  To  increase  the  field  of  view, 
however,  requires  camera-quality  optics. 

To  understand  the  optical  requirements,  let  us  sim- 
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Fig.  5.  (’rane  and  Cornsweet  focus  stimulator:  l)S,  display  screen; 
A/’.  artificial  pupil  plane.  Mirrors  ff2and  /f<  are  moved  orthogonal 
to  the  optic  axis  to  change  the  optical  distance  to  DS 
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Fig.  6.  (a)  Schematic  diagram  of  a  relay  lens  pair  with  a  visual  field 

20.  The  pupil  plane  of  the  eye  is  placed  at  the  focal  plane  of  L\. 
Assume  the  eye  is  focused  at  infinity,  i.e.,  d  =  /  C.  F.  depicts  curva¬ 
ture  of  Field.  (b)  Camera  quality  lenses  arranged  for  minimal  blurring 
of  images  at  the  retina,  (c)  Camera  quality  lenses  arranged  to  min¬ 
imize  spherical  aberration. 


plify  the  drawing  by  straightening  out  the  path  between 
the  lenses  of  Fig.  5,  as  shown  in  Fig.  6(a),  in  which  the 
eye  is  shown  focused  for  infinity,  and  the  image  of  dis¬ 
play  screen  DS  is  also  at  infinity,  i.e.,  d  =  f.  In  effect, 
the  eye  views  the  target  through  the  entrance  pupil 
formed  by  lenses  L  i  and  L2.  There  are  two  conflicting 
requirements  for  good  imaging  in  this  case.  First,  zero 
field  distortion  requires  that  the  chief  rays  (shown  dark 
in  the  figure)  passing  through  the  center  of  the  real  pupil 
should  also  intersect  at  the  center  of  the  pupil  image. 
(In  this  case,  the  field  angle,  labeled  26,  would  be  the 
same  whether  seen  from  the  real  pupil  or  from  the  pupil 
image.)  This  requires  zero  spherical  aberration  in  the 
plane  of  the  pupil.  Second,  note  that  a  real  image  of  the 
infinitely  distant  scene  is  formed  in  the  plane  between 
the  two  lenses.  This  real  image  serves,  in  turn,  as  the 
virtual  object  for  lens  l ,  | .  Any  curvature  of  field  in  this 
image  plane,  as  suggested  by  curved  line  C.F.  in  the 
figure,  would  cause  off-axis  blurring  of  the  image  at  the 
retina.  These  requirements — zero  spherical  aberration 
and  flat-field  imaging — generally  conflict  for  doublet 
lenses. 

Camera  lenses  substituted  for  lenses  L  \  and  /.2  should 
be  arranged  as  shown  in  Fig.  6(b)  to  minimize  blurring 
of  the  target  at  the  retina.  That  is,  they  should  be  ar¬ 
ranged  as  though  the  plane  between  the  two  lenses  is  the 
normal  film  plane;  camera  lenses  are  specifically  de¬ 
signed  for  flat-field  imaging  in  this  direction.  On  the 


other  hand,  to  minimize  spherical  aberration  in  imaging 
the  eye  pupil,  the  lenses  should  be  reversed,  as  shown 
in  Fig.  6(c).  Recall  that  with  respect  to  the  pupil,  the 
rays  are  collimated  between  the  lenses.  The  design 
discussed  here  is  based  on  a  relatively  symmetric  50-mm 
Olympus  f/l.H  camera  lens  which  can  be  used  almost 
equally  well  in  Inith  directions,  although  configuration 
6(c)  provides  a  significantly  wider  field  of  view. 

The  difficulty  with  camera  lenses,  whether  used  in 
configuration  6(b)  or  6(c),  is  that  they  are  too  large  to 
use  with  the  four-mirror  scheme  of  Fig.  5.  The  only 
practical  arrangement  is  to  move  the  lens  itself,  as  il¬ 
lustrated  in  Fig.  7(a).  The  disadvantage  of  moving  the 
lens  is  that  unless  the  display  screen  is  at  optical  infin¬ 
ity,  the  distance  from  the  screen  to  the  lens  is  then 
variable,  and  the  image  formed  between  the  lenses  is  no 
longer  constant  in  size.  The  situation  can  be  remedied 
with  an  extra  fixed  lens  if  the  display  screen  can  be 
placed  directly  in  the  focal  plane  of  the  extra  lens.  By 
using  two  extra  lenses,  l.\  and  L 4  |as  shown  in  Fig.  7(b), 
where  L\  generates  a  real  image  of  the  display  screen  in 
the  focal  plane  of  lens  L3|,  the  system  can  then  accom¬ 
modate  a  continuous  range  of  distances  between  the 
device  and  display  screen.  That  is,  for  a  given  position 
of  the  display  screen  DS,  lens  L4  is  adjusted  axially  until 
image  DS'  is  in  the  focal  plane  of  lens  L3.  This  places 
the  image  DS'  of  DS  at  infinity,  making  the  image  size 
independent  of  focus  adjustments. 

Two  extra  lenses  are  necessary,  in  any  case,  for 
achieving  two-axis  visual  deflection  as  well  as  focus 
control.  That  is,  two  separate  images  of  the  eye  pupil 
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Fig.  7.  (a)  Simple  focus  stimulator.  I  *ns  1.2  moves  axially  to  vary 

dioptric  power;  artificial  pupil  AP  eliminates  any  effects  caused  by 
changes  in  the  eye  pupil;  DS,  display  screen,  (b)  Focus  stimulator 
that  compensates  for  variable  axial  position  of  the  display  screen.  L4 
is  moved  axially  to  create  an  image  of  DS  in  the  focal  plane  of 
thereby  ensuring  that  the  target  DS  appears  at  optical  infinity  to  the 
focus  stimulator  system  (L\,  L7)  (c)  Three-dimensional  visual 

stimulator;  M v  and  MH,  rotating  mirrors;  CR ,  center  of  rotation  of 
eye;  CR \ CR”,  first  and  second  images  of  CR.  With  CR'  and  CR”  on 
the  axes  of  rotation  of  Mv  and  Mh.  respectively,  vertical  and  hori¬ 
zontal  movement  of  the  visual  field  is  achieved  without  translation 
artifact. 
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Fig  8.  Th reo -dimensional  visual  stimulator  (see  schematic  diagram 
of  Fig.  H. 


are  required  as  locations  for  two  single-axis  mirror  de- 
(lectors,  as  illustrated  in  Fig.  1  and  again  in  Fig.  7(c). 
Mirror  M\  is  positioned  at  the  first  image  location 
(between  the  two  lens  pairs);  mirror  MH  is  located  at  the 
second  image  location  (l>eyond  the  second  lens  pair).  It 
was  noted  earlier  that  to  achieve  pure  rotation  of  the 
visual  field  without  translation  effects,  it  is  necessary 
that  the  eye's  center  of  rotation  be  conjugate  to  some 
point  on  the  axis  of  rotation  of  each  mirror.  If  lens  L2 
were  used  for  focus  control,  as  shown  in  Fig.  7(b),  both 
images  of  the  eye’s  center  of  rotation  would  shift  axially 
with  respect  to  the  mirror  axes  shown  in  Fig.  7(c),  unless 
both  servomotor  mirror  assemblies  shifted  axially  by 
different  amounts  in  synchronism  with  Z,2.  The  system 
is  greatly  simplified  if  lens  /,<  is  used  instead  for  focus 
adjustment,  in  which  case  only  mirror  assembly  Mh 
must  be  moved  axially,  as  shown  in  Fig.  7(c). 

Wit h  the  position  of  I  ,ens  /,4  adjustable,  the  spacing 
between  lenses  /,:)  and  is  no  longer  constant,  and  the 
imaging  of  the  eve  at  mirror  Mu  is  no  longer  distor¬ 
tionless  as  it  would  lie  if  the  distance  between  /,:1  and 
were  equal  to  the  sum  of  their  focal  lengths.  But  only 
small  errors  result.  Appendices  A,  B,  and  C  analyze  the 
magnitude  of  the  errors  inherent  in  the  system. 

Ml.  Performance 

Figure  H  shows  the  3-1)  visual  stimulator.  The  field 
of  view  is  approximately  25°  in  diameter.  The  center 
of  t  he  field  ran  be  moved  through  an  angle  subtending 
±  1  o'  vertically  and/or  ±20°  horizontally  at  the  eye. 
The  spherical  power  can  he  changed  from  —4  diopters 
to  +11  diopters  with  a  movement  sensitivity  of  2.5 
mm/diopter.  Kach  camera  lens  has  ten  surfaces.  The 
loss  of  light  when  viewing  through  the  forty  coated 
surfaces  of  four  camera  lenses  in  series  is  equivalent 
approximately  to  a  0.3  neutral  density  filter. 
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The  electronics  that  produce  horizontal  and  vertical 
deflections  consist  of  the  two  General  Scanning 
CCX-101  amplifiers  that  drive  the  G300PD  Optical 
Scanners  (see  Fig.  9).  The  scanners  have  angular 
rotation  sensors  that  are  used  to  derive  angle  and  angle 
rate  signals  that  are  part  of  a  servo  loop.  A  readout  of 
the  angular  position  of  the  scanners  is  available.  Gain 
and  offset  controls  condition  the  input  signal  while  loop 
gain  and  damping  adjustments  are  also  available. 

The  deflection  servosystems  are  capable  of  rotating 
the  mirrors  by  more  than  25°  (50°  movement  of  the 
visual  target)  with  a  linearity  of  ±0. 1%  of  the  excursion. 
The  resolution  is  approximately  10  sec  of  arc  with  a 
response  from  dc  to  3-dB  bandwidth  of  200  Hz.  The 
delay  time  (0-10%)  is  less  than  1.5  msec,  and  the  10-90 
risetime  is  less  than  2.5  msec.  The  total  response  time 
is  approximately  6  msec  . 

The  focus  servo,  a  closed-loop  system  with  position 
feedback,  is  capable  of  changing  spht  .-ical  power  by 
more  than  14  diopters  with  a  sensitivity  of  approxi¬ 
mately  9  diopter/V.  The  linearity  is  ±0.25%  of  the 
peak-to-peak  range  with  a  repeatability  of  less  than  0.1 
diopters.  The  time  delay  to  a  step  is  12  msec  with  a 
maximum  slewing  rate  of  40  diopter/sec. 

IV.  Summary 

A  3-D  visual  stimulus  deflector  consists  of  four 
identical  camera  lenses  in  series.  It  is  shown  that  a  pair 
of  identical  lenses  separated  by  the  sum  of  their  focal 
lengths  generates  an  undistorted  3-D  image  indepen¬ 
dent  of  the  distance  that,  the  object  is  from  the  lens  pair. 
With  two  such  pairs  of  lenses,  two  undistorted  images 
are  created,  one  in  the  space  between  the  second  and 
third  lens  and  one  in  the  focal  plane  beyond  the  fourth 
lens.  The  eye  sees  the  world  as  though  viewing  through 
this  second  image  of  itself.  A  rotatable  mirror  is  located 
at  each  of  thes?  image  positions  and  adjusted  so  that  the 
image  of  the  eye’s  center  of  rotation  falls  on  each  axis 
of  rotation.  In  this  case,  the  field  of  view  seen  by  the  eye 
can  be  moved  as  though  with  a  pure  eye  rotation,  that 
is,  without  translational  effects.  A  mirror  that  rotates 
about  a  horizontal  axis  is  located  at  the  first  image  po¬ 
sition,  and  a  mirror  that  rotates  about  a  vertical  axis  is 
located  at  the  second  image  position.  These  mirrors 
move  the  visual  world  in  a  vertical  and  horizontal  di¬ 
rection. 

Focus  change  is  achieved  by  moving  the  fourth  lens 
and  second  mirror  in  synchronism  along  the  optical  axis 
of  the  device.  Although  such  movement  alters  the 
spacing  between  the  third  and  fourth  lenses  (so  they  no 


Fix,  9-  Schematic  diagram  of  deflection  servoloop  electronics. 
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The  height  2 h'  of  the  accepted  ray  bundle  at  the  lens 
can  be  written  as 


2h' 


—  ■  ih  -  — 

d  I 


•  2 h. 


(A2) 


(d/q) 

where  2h  is  the  object  size.  The  angular  size  of  the 
object,  as  seen  from  the  eye,  is 


Fig.  10.  Diagram  of  the  change  in  visual  angle  as  a  function  of  object 
distance  d  from  lens  l ,  i  and  axial  misalignment  of  the  eye  by  distance 
Aft  from  the  f«>cal  plane  of  L\. 


Fig.  1 1 .  Percent  error  in  the  visual  angle  6  as  a  function  of  the  dis¬ 
tance  d  of  the  ohject  from  lens  L\(f  =  f>0  mm). 


longer  form  a  distortionless  imaging  system)  the  errors 
thereby  induced  are  small  (see  Appendices). 

The  instrument  is  built  around  four  50-mm  // 1.8 
camera  lenses.  It  can  move  a  visual  stimulus  25°  in 
diameter  over  a  range  of  40°  horizontally  and  30°  ver¬ 
tically.  The  optical  focus  of  the  object  being  viewed  can 
l>e  changed  over  a  1 5-diopter  range,  while  the  brightness 
and  visual  angle  subtended  by  the  object  remain  in¬ 
variant.  Movement  of  the  two  mirrors  and  the  axial 
movement  of  the  last  lens  and  second  mirror  system  are 
controlled  by  three  independent  servosystems. 

Appendix  A 

It  was  stated  in  the  body  of  the  paper  in  connection 
with  Fig.  4  that  if  the  eye  is  located  in  the  focal  plane  of 
lens  l,  i ,  the  image  size  is  independent  of  distance  d.  Let 
us  inquire  how  sensitive  this  constancy  is  to  the  axial 
position  of  the  eye. 

Assume  the  eye  is  moved  a  distance  AE  from  the  focal 
plane,  that  is,  the  eye  is  at  a  distance  f  +  AE  from  lens 
L\,  and  that  the  eye  pupil  is  stopped  down  to  a  pinhole. 
In  this  case,  the  rays  accepted  from  each  point  of  the 
object  will  no  longer  be  parallel,  as  shown  in  Fig.  4,  but 
will  converge  as  shown  in  Fig.  10.  These  accepted  rays 
intersect  at  a  distance  q  from  the  lens,  where  p  and  q 
can  be  thought  of  as  object  and  image  distances,  that 
is. 


20~(2h'l/f/  +  AA').  (A3) 

where  the  small-angle  approximation  is  made  that  the 
angle  is  equal  to  its  tangent.  Substituting  Eqs.  (Al)  and 
(A2)  into  Eq.  (A3)  gives  the  equation 


Aft  /  d  \ 


r.  *£/ 

,^1 

l1  /  v 

1  f)\ 

where  the  half  angle  0(l  =  h/f. 

Note  that  0  =  0O  either  if  A E  =  0  (i.e.,  if  the  eye  is  in 
the  focal  plane)  or  if  d  =  f  (i.e.,  if  the  object  being  viewed 
is  at  infinity).  If  A E  S  0,  the  image  size  will  change  as 
the  object  distance  d  changes.  Figure  1 1  is  a  plot  of  the 
error  factor  ( A E/f)  [  1  —  (d/f)\  for  a  50-mm  (20-diopter) 
lens.  Note  that  according  to  Eq.  ( 14)  the  eye  will  ex¬ 
perience  a  20-diopter  change  when  the  object  shifts  from 
d  =  f  to  d  =  0  (i.e.,  for  a  movement  equal  to  f).  The 
diopter  change  per  millimeter  of  object  movement  can 
therefore  be  written 

/  P 

S  =  — — - -  = - mm/diopter  (A6) 

1000//  1000 

or  2.5  mm/diopter  for  a  50-mm  lens. 

From  Fig.  1 1,  we  see  that  with  t!.e  eye  displaced  2  mm 
axially,  there  is  a  1%  change  in  image  size  for  a  6-diopter 
change  (i.e.,  for  a  movement  from  d  =  50  mm  to  d  =  35.0 
mm). 

If  the  device  is  used  as  an  ocular  corrector,  it  is  not 
important  that  the  eye  be  in  the  exact  axial  plane  be¬ 
cause  the  target  distance  will  not  be  changed.  If  the 
device  is  to  stimulate  focus  change  with  constant  image 


Fig.  12.  Schematic  representation  of  the  axial  shift  Aqi,  of  an  image 
because  of  a  shift  AL  of  Lj.  The  eye  is  at  a  distance  f  +  AE  from 
(a)  Before  lens  movement,  the  object,  height  2 H,  is  at  a  distance  p. 
from  Lt  and  forms  an  image  of  height  2h„  at  distance  q0  from  L  t  and 
do  ™  /  from  h|.  (b)  After  lens  movement  AL .  the  object  is  at  distance 
p  m  pa  +  AL  from  Li,  and  the  image,  height  2h,  is  shifted  by  Aqi.  to 
distance  q  from  Lt  and  d  from  L\. 
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size,  however,  alignment  is  important.  The  simplest 
way  to  adjust  axial  eye  position  is  to  move  the  eye  axially 
slowly  while  the  target  shifts  back  and  forth,  until  the 
subject  reports  no  size  change  associated  with  the  focus 
change.  If  the  eye  is  too  close  to  (or  too  far  from)  the 
lens,  the  target  will  increase  (or  decrease)  in  size  as  the 
target  is  brought  toward  the  lens — i.e.,  decreasing  d. 

Appendix  B 

Figure  7  illustrates  an  axial  lens  shift  to  vary  the 
focus.  As  we  saw,  however,  unless  the  target  is  at  in¬ 
finity,  this  axial  movement  will  cause  a  change  in  the 
size  of  the  image.  Also,  the  image  will  not  move  exactly 
the  same  amount  as  the  lens  movement.  For  the  pur¬ 
pose  of  the  following  analysis,  let  A <?/,  be  the  amount  the 
image  moves  in  response  to  a  lens  movement  A L.  The 
situation  is  shown  in  Fig.  12,  where  a  deliberate  axial 
shift  of  the  eye  is  used  to  compensate  for  this  variation 
in  image  size.  In  other  words,  focus  change  can  be 
achieved  while  maintaining  constant  image  size  even 
with  the  target  not  at  optical  infinity.  To  obtain  this 
result,  we  must  find  a  value  of  A E  such  that  6  (image 
size)  is  independent  of  d  (distance). 

Equation  (A4)  shows  the  general  relation  between  8Ji, 
A E,  and  d,  where  the  size  of  the  real  image  being  viewed 
2h  is  now  a  variable.  We  will  derive  general  relations 
for  h  and  d  as  functions  of  A L. 

By  differentiating  the  general  lens  equation, 

q  *  (p/)/(p  - /).  (Bl) 

with  respect  to  p,  we  find  that  for  a  small  change  A p  in 
object  distance  (lens  fixed  in  position),  the  corre¬ 
sponding  change  in  q  is 

aq  =  —  (</2/p2)Ap.  (B2) 

If  the  object  distance  change  is  because  of  a  shift  A L  in 
the  lens,  however,  rather  than  because  of  a  change  in 
object  position,  the  corresponding  change  in  image 
position  is  simply  equal  to  Aq  plus  the  amount  of  the 
lens  movement,  i.e., 

AqL  =  At  +  A  q.  (B3) 

Substituting  Eq.  (B2)  into  Eq.  (B3)  and  noting  that  A p 
=  A L,  we  obtain 

AqL  =  A/. 1 1  -  (<?/p)2|  (B4) 

In  other  words,  if  the  lens  moves  by  an  amount  A L  to 
the  left,  the  distance  d  decreases  to 

d  ■  d0  -  AqL  (B5) 

-  do  -  A£|l  -  <fl/pl2|.  (B6) 

Let  us  consider  next  how  image  size  varies  with  A L. 
The  ratio  of  image  size  to  object  size  is  directly  related 
to  the  ratio  q/p,  that  is, 

2 h  -  (q/p)  ■  2 H.  <B7) 

where  q  and  p  can  be  expressed  as 

p  ”  p„  +  A p,  (B8) 

q  ■  q0  +  Aq  ■  q0  -  ( q/p)2Ap .  <B9) 
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Substituting  Eqs.  (B8)  and  (B9)  into  Eq.  (B7),  we  ob¬ 
tain 


-[©'“] 


where  h„  =  (q0/p„)H.  Ignoring  second-order  terms, 
Eq.  (BIO)  becomes 


where  A L  is  substituted  for  Ap.  Substituting  Eqs.  (B6) 
and  (Bl  1)  into  Eq.  (A4)  and  ignoring  the  subscripts  on 
p,  q,  and  d,  we  obtain 

«- - ^ - - (B12) 

/[l  +  —  (/-->]  A*AI.(|-J|) 

1  + - 

/2  +  AE(J  -  d) 

Note  that  if  the  last  terms  of  both  the  numerator  and 
denominator  are  equal,  Eq.  (B12)  reduces  to 


I  1  +  |(A £)/</2)l</  -  d) 

and  6  is  independent  of  A L,  which  is  what  we  wished  to 
demonstrate.  The  equality  of  numerator  and  denom¬ 
inator  in  Eq.  (B12)  requires  that 

-/» 

AE  - - - - (B14) 

(p  -  q)  +  (J  -  d) 

Figure  13  is  a  plot  of  Eq.  (B14)  for  f  =  d.  i.e.,  where 
the  target  appears  to  be  at  infinity,  and  therefore  defines 
the  initial  A E  for  most  experimental  conditions.  Note 
that  A E  is  negative  because  as  lens  L2  moves  toward 
lens  L;,  the  image  decreases  in  size.  To  compensate  for 
this  decrease,  the  eye  must  be  moved  closer  to  lens  Li. 
For  example,  for  an  object  1  m  away  (p  =  1000  mm),  the 


Fig.  1 3.  Plot  of  A £  u  a  function  of  the  object  distance  p  (from  Li) 
necessary  to  produce  constant  size  imaging  by  lens  system  L  i,  Lj  in 
Fig.  12.  Note  that  /  »  d. 
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Fig.  14.  Diagram  of  the  axial  movement  Aq'  of  the  second  image  CR' 
of  the  eye's  center  of  rotation  CR  as  a  function  of  (Lt,  Mh)  movement 
by  amount  Ax.  Before  movement,  Ax  is  zero  and  x  -  2 /;  CR'  is  at 
a  distance  q,,  from  /. « and  falls  on  the  axis  of  rotation  of  M h-  After 
movement.  OR'  is  displaced  by  Aq'  from  the  axis  of  rotation  of  Mh 
The  first  image  OR'  of  OR  is  formed  at  the  axis  of  rotation  of  My, 
which  is  at  a  fixed  distance  p  from  L3.  An  image  of  OR'  is  formed  at 
distance  4'  from  /,<. 


eye  must  be  moved  approximately  2.5  mm  closer  to  L\. 
Note  that  there  is  a  very  small  sensitivity  to  the  exact 
slide  position  before  it  is  moved.  For  example,  for  p  = 
1000  mm,  there  is  approximately  a  1.3%  change  in  AE 
for  d 0  =  /  (the  slide  at  the  infinity  position)  or  for  do  - 
y  (the  slide  at  the  5-diopter  position). 


Appendix  C 

Even  if  mirror  Mh  moves  in  synchronism  with  lens 
L4,  as  illustrated  in  Fig.  7(c),  the  second  image  CR"  of 
the  eye’s  center  of  rotation  moves  away  from  the  surface 
of  mirror  MH  as  lens  L4  moves  over  its  range,  as  shown 
in  Fig.  14.  Therefore,  rotation  of  MH  will  not  be  per¬ 
ceived  as  pure  rotation  by  the  eye.  The  following  dis¬ 
cussion  quantifies  the  expected  variation  of  the  trans¬ 
lation  component  thereby  induced. 

Figure  14  depicts  the  geometry  of  interest.  CR’,  the 
image  of  CR  formed  at  Mv,  is  at  a  distance  p  from  L3.3 
Its  image  distance  q  may  be  written 

q  -  ( p/)/(p  -  /)  (Cl) 

The  object  distance  p'  for  lens  Lt  can  be  written 

p'  ■  X  -  q  *  X  -|(p/)/(p  -  /)]<  0,  (C2) 

where  x  is  the  separation  between  lenses  Ln  and  L4. 
The  separation  x  can  in  turn  be  written  as 


i  -  2/  +  Ax. 


(C3) 


where  Ax  (positive  or  negative)  represents  the  simul¬ 
taneous  movement  of  L4  and  Mh,  as  shown  in  Fig.  7(c). 
Substituting  Eqs.  (Cl)  and  (C3)  into  Eq.  (C2),  we 
have 


.  p/  -  V1 
p-l 


+  Ax- 


<C4> 


For  simplicity,  if  we  assume  p  =  kf,k  >  l,  then  Eq.  (C4) 
becomes 


p'  -  «*  -  2 )/(*  -  i)|/ +  Ax. 

The  final  image  distance  q’  is 

,m  P'f  _((*-2>/(»-  I )[/»+( Ax)/ 
,mp'-f"  «-/)/(*-  1)1  +  Ax 


(CS) 

<C6) 


Dividing  the  numerator  by  the  denominator,  we  have 

,'-/+<!  -*)//[)  ^  Ax] 

~/+|<l  -*)/|[l  +^-^Ax] 

*  (2  -*)/-(*-  l)*Ax  <C7) 

Writing  q’  in  the  form 


q‘  =  <Jo'  +  A q‘ 


and  substituting  Eq.  (C7)  into  Eq.  (C8),  we  have 


<C8) 


q„'=  (2-*)/. 


<C9) 


Aq'  (A  —  I  )g  Ax 

<?„'  2  -  *  / 


(CIO) 


Figure  15  is  a  plot  of  |  Aq’)/(q0')\  as  a  function  of 
(Ax)//,  assuming  k  =  1.2.  The  maximum  variation  is 
2.5%  of  q0'  in  the  worst  case.  This  error  will  cause  the 
conjugate  image  of  the  center  of  rotation  to  be  displaced 
by  this  amount  from  the  axis  of  the  rotating  mirror  Mh 
Consequently,  the  rotation  of  the  eye  caused  by  a  given 
angular  rotation  of  the  mirror  will  not  be  exactly  the 
same  as  the  mirror  rotation,  or  conversely,  the  rotation 
of  the  mirror  necessary  to  compensate  a  given  eye 
rotation  will  not  be  exactly  the  same  size  as  the  eye 
rotation. 

The  rotational  error  is  depicted  in  highly  exaggerated 
form  in  Fig.  16,  where  for  simplicity  the  target  is  shown 
along  the  axis  rather  than  as  deflected  by  mirror  Mh 
(i.e.,  as  though  Mh  were  not  there).  If  Mh  caused  the 
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Fig.  15.  Percent  error  |(Aq')/(q0')|  as  function  of  the  change  in  axial 
separation  ( Ax )//  of  tx.  Lt 


Fig.  16.  Schematic  diagram  of  the  difference  between  rotational 
angle  4  and  visual  angle  #,  where  the  target  is  at  a  distance  b  from  the 
axis  of  rotation  of  Mu  and  where  the  axis  of  rotation  of  Mh  and  CR' 
ire  saps  rated  by  a  distance  A q‘. 
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target  to  be  rotated  through  an  angle  <8,  the  eye  must 
rotate  through  an  angle  B,  where  and  B  differ  by  an 
amount 

(Cl  I) 

because  of  the  offset  A q'.  These  angles  can  be  written 
as 

*  =  tan-'(a/6).  <C!2> 

0  =  tan -'|o/(6  -  Aq')|.  (03) 

where  b  is  the  target  distance  from  the  axis  of  the  mir¬ 
ror,  which  is  approximately  1  cm  larger  than  the  dis¬ 
tance  from  (the  image  of)  the  pupil  to  the  target.  For 
the  present  applications, 


«  <  10” 

(C14) 

and 

b  >  10  cm  (0*  <  10  diopters). 

(C15) 

Therefore, 

a  <  6  tan  10°  =  0.176*. 

(C16) 

From  Eqs.  (C9)  and  (CIO),  it  can  be  noted  that 

|Aq'|  =(*  -  l)sAs. 

(C17) 

In  the  present  design,  k  =  1.2  and  Ax  <  f/2.  Given 
/  =  50  mm,  then  b  >  2/  =  10  cm.  When  we  combine 
these  relationships,  Eq.  (C17)  becomes 

|Aq'|  -  0.04 As  <  0.02/  <  0.01ft, 

(CIS) 

B  <  tan-,(0. 176/0.99)  =  10.1°, 

(C19) 

T  =  «-*  <  0.1*. 

(C20) 

Thus,  in  the  worst  case,  there  is  an  (0.1/10)  or  1%  error 
between  actual  eye  rotation  and  rotation  of  Mh  because 
of  the  movement  of  lens  LA. 

If  <t>  and  the  dioptric  power  [Df  =  (1/6)]  are  constant, 
the  gain  of  the  servo  driving  Mh  can  be  changed  to 
overcome  this  artifact,  since  the  correction  factor  is  a 
constant.  Also  if  <t>  *  0  or  D*;  <  0,  this  error  is  negligi¬ 
ble.  Finally,  if  the  error  is  noticeable  and  the  position 
of  L,  is  fixed  (D*  =  constant),  Aq'  might  be  reduced  to 
zero  by  locating  the  mirror  Mh  at  a  distance  q'  from 

U 

This  development  was  supported  by  grant  1  R01 
EY01031  from  the  Department  of  Health,  Education, 
and  Welfare.  The  authors  acknowledge  the  contribu¬ 
tions  of  Lloyd  Alterton  and  Carroll  Steele  of  Stanford 
Research  Institute  to  the  mechanical  and  electronic 
design. 
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1 .  We  use  the  convention,  here,  of  staling  refractive  power  of  the  eye 
relative  to  its  power  when  accommodated  for  infinity,  that  is,  0.0 
diopters  of  refractive  power  means  that  the  retina  is  conjugate  with 
infinity,  at  2.0  diopters,  the  retina  is  conjugate  with  a  plane  1/2.0 
m  away,  etc.  The  absolute  refractive  power  of  a  normal  eye  ac¬ 
commodated  for  infinity  is  about  60  diopters  (i.e.,  its  equivalent 
focal  length  is  about  17  mm). 

2.  H.  D.  Crane,  and  T.  N.  Cornsweet,  J.  Opt.  Soc.  Am.  60,  577 
(1970). 

3.  The  position  of  CR'  is  determined  by  the  Tact  that  the  image  of  the 
eye  pupil  must  be  located  in  the  focal  plane  of  L3  to  ensure  con¬ 
stancy  of  brightness  and  image  sise  independent  of  the  position 
oft,. 
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